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Mean field glassy systems have a complicated energy landscape and an enormous number of 
different Gibbs states. In this paper, we introduce a generalization of the cavity method in order 
to describe the adiabatic evolution of these glassy Gibbs states as an external parameter, such as 
the temperature, is tuned. We give a general derivation of the method and describe in details the 
solution of the resulting equations for the fully connected p-spin model, the XOR-SAT problem and 
the anti- ferromagnetic Potts glass (or "coloring" problem). As direct results of the states following 
method, we present a study of very slow Monte-Carlo annealings, the demonstration of the presence 
of temperature chaos in these systems, and the identification of a easy/hard transition for simulated 
annealing in constraint optimization problems. We also discuss the relation between our approach 
and the Franz-Parisi potential, as well as with the reconstruction problem on trees in computer 
science. A mapping between the states following method and the physics on the Nishimori line is 
also presented. 
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Introduction 

Both in classical and quantum thermodynamics, it is often practical to discuss very slow variations of an external 
parameter so that the system remains at equilibrium, and such very slow changes are referred to as adiabatioi. When 
a macroscopic system is in a given phase, and if one tunes a parameter, say the temperature, very slowly then all 
obscrvables, such as the energy or the magnetization in a magnet, will be given by the equilibrium equation of state. 

Such considerations have to be revisited close to a phase transition where it is impossible to be truly adiabatic, and 
this is the subject of modern out-of-equilibrium theories. However, given a system at equilibrium in a well defined 
phase, it is always possible to consider the adiabatic evolution. In the low temperature phases of a ferromagnet, 
for instance, the evolution of the magnetization is different in the two phases (or Gibbs states) corresponding to the 
positive or negative magnetization. To describe this theoretically, one can force the system to be in the Gibbs state 
of choice (for instance by adding an external infinitesimal field, or fixing the boundary conditions) and then study the 
adiabatic evolution for each of these phases. 

This simplicity, however, breaks when one considers glassy systems where the energy landscape is very complicated, 
and especially in the mean field setting where exponential number of phases (Gibbs states) exists. Adiabatic evolution 
of phases in mean field glassy systems is, however, a very important problem that has been considered — via some 
approximation or in very specific solvable cases — in a number of works^Ti^. How to deal with this situation in general 
mean field glassy systems, how to chose a particular phase, and how to follow it adiabatically is the subject of the 
formalism presented in this work. 

Mean- field glassy systems are important in many parts of modern science. We shall call a system a "mean- field" 
one whenever a mean-field treatment is exact for this system: this is the case for all spin or particle models on fully 
connected lattices (such as the Curie- Weiss model of fcrromagncts) or on sparse random lattices that arc locally tree- 
like (such as the Bethe lattice). Over the last few years, studies of mean- field glassy systems brought many interesting 
results in physics as well as in computer science. Without being exhaustive, we can mention the development of mean 
field theories for structural glass former o^^i^^ , for the jamming transition and amorphous packingi^, heteropolymer 
foldingi2., or for quantum disordered materials^^ on the physics side. On the computer science side, many results 
have been obtain using mean field theory on optimization problems and neural networki^, and more recently random 
constraint satisfaction problems have witnessed a burst of new results via the application of the survey propagation 
algorithm and related technique o^^'^^ . The theory of error correcting codes is also closely related to glassy mean field 
systemic, etc. 

A common denominator in all these systems is their complex energy landscape and a large number of phases 
(states), whose statistical features are amenable to an analytical and quantitative description via the replica and 
cavity method o^^i^^ . However, important and deep questions about the dynamical behavior in these systems remain 
largely unsolved, and many of them can be addressed by the knowledge of the slow dynamics. In order to motivate 
our approach, let us first discuss the basic universal features of the thermodynamic behavior of mean-field glassy 
models. As an external parameter, say the temperature T, is tuned, a typical glassy system undergoes the following 
changes: At high temperature, the system is in a paramagnetic/liquid phase. Below the dynamical glass temperature 
Td, this phase shatters into exponentially many Gibbs states/phases, all well separated by extensive energetic or 
entropic barriers, leading to a breaking of ergodicity and to the divergence of the equilibration time^ '^°i^^ . As the 
temperature is further lowered, the number of states (relevant for the Boltzmann measure) may become finite and 
the structural entropy (or complexity) vanishes, this defines the static Kauzmann transition, Tk, arguably similar to 
the one observed in real glass former o^^'^^ . This scenario is called the "one-step replica symmetric" (IRSB) picture. 
In some models^, the states will divide further into an infinite hierarchy of sub-states, a phenomenon called "full 
replica symmetry breaking" (FRSB) ^'^i-'-^ . 

The IRSB picture is well established in many mean field systems, and the cavity /replica method is able to compute 
the number, the size or the energy of the equilibrium Gibbs states. However, with the exception of few simple 
models^ii^ii^"— , an analytical description of the dynamics and of the way states are evolving upon adiabatic change of 
external parameters is missing. Let us consider a given setting where the need for adiabatic following is clear: Imagine 
an annealing experiment where the temperature T is changed in time as T = Tq — St/N. Take the thermodynamic 
limit N oo first and then consider a very slow annealing J -> 0. As long as we stay in the paramagnetic phase, 
we expect that such a slow annealing will equilibrate. The fact that the equilibration time is finite below Td can 
be actually proven^ii^l and such annealing should be thud able to equilibrate down to the dynamical temperature 
Td after which the system get stuck in one of the many equilibrium Gibbs states. Computing the energy of the 
lowest configuration belonging to this state would thus give the limiting energy for a very slow annealing (and thus 
would give a bound to the performance of any annealing scheme). However, while the standard cavity and the replica 
method predict all the properties of an equilibrium state at a given temperature (equilibrium temperature), they 
do not tell how these properties change for this precise state when the temperature changes adiabatically to Ta ^ Te 
(actual temperature). A word of caution: We want to follow the state and stay in it. Hence by "adiabatic" we mean 
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FIG. 1: (color online) A cartoon of the energy landscape in mean field glassy systems. The different valleys correspond to 
different Gibbs states and are separated by extensive barriers. For energies lower than Cd (the brown line), ergodicity breaks 
because of these barriers. The ground state energy of the system is eos (in green). The standard cavity and replica method 
can compute how many states of a given size/entropy are present at a given energy/temperature e/T. The states following 
method we develop in this paper instead pins down one state (in red in the figure) that is one of the equilibrium ones at energy 
Be (corresponding to temperature Te, the blue line) and computes its properties (entropy, energy) for another temperatures Ta- 
we are thus following a given state as temperature (or any other parameter) is changed. At Ta = 0, this leads for instance to 
the properties of the bottom of the state as e.g. the limiting energy ebottom- 

here slow only linearly in the size of the system, corresponding to very long experimental times; an exponentially slow 
annealing always finds the ground state, but this is of course unfeasibly long. 

The extension of the cavity method that we introduced in a recent Letter— precisely answered these questions by 
following adiabatically the evolution of any Gibbs state when an external parameter is changed (for an intuitive and 
pictorial description of our goals, see Fig.[T]). This gives detailed quantitative information about the energy landscape 
and the long time dynamics. The aim of this subsequent publication is to derive the method in general, to discuss 
in detail the solutions of the resulting equations, and to discuss relations with some other settings (reconstruction on 
trees^, Franz-Parisi potentialSli^, Nishimori line^S). We anticipate that the method will become part of the standard 
tool-box for mean field glassy systems and hence a detailed presentation is appropriate. 

The paper is organized as follow: In Sec. |T] we give a brief reminder of the usual cavity method. In the two next 
section, we present our formalism for the adiabatic evolution of states from temperature higher (Sec. |ll| and lower 
(Sec. IIII| ) than the spin glass static/Kauzmann transition. We finally solve these equations and present our results 
for a fully connected model in Sec. llVl and for diluted models on the Bethe lattice in Sec. fVl 

I. PRELIMINARIES 

In this section, we first review the results of the standard cavity method that we shall use all along the text. The 
specific example for which we shall derive most of the results of this paper is the p-spin model, also called the XOR- 
SAT problem. However, the derivation for all other models where the cavity methodic can be used goes in the very 
same lines (and we will also work later on with the coloring problem). The reader familiar with the cavity method 
can skip this section and go directly to Sec. |lll 

A. The p-spin model and XOR-SAT reminder 

The p-spin model is defined by its Hamiltonian 

where Si £ {—1, -1-1} are the Ising spins, a are interactions between p-uples of spins, Ja is the strength of the interaction. 
In what follows we will focus on two cases of the p-spin model: 
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• XOR-SAT (parity check) problem: In this case all the interactions \ Ja\ = 1. The interactions can be both 
ferromagnetic and anti-ferromagnetic 

Q{Ja) = pS{Ja + 1) + (1 - p)S{Ja - 1) ■ (2) 

In the results section we mostly consider the spin glass case p = 1/2. The number of interactions M (linear 
equations) is M = aN, where a is the constraint density. The degree distributions Q{1) of variables have to be 
specified here. The number of violated parity checks (constraints) is E = {AI + 7i)/2. The values of temperature 
for the ii'-XOR-SAT problems arc hence related to those for the p-spin problem via a multiplicative factor 2, 
note that here and through the paper K = p. 

• Fully connected p-spin model: The interactions a exist for every possible p-uple of spins, the mean and variance 
of Ja are given by (J^) = JoP^-/NP-^ and (J^) - (J,)2 = J^p\/{2NP-^). 

The XOR-SAT problem was studied and solved in^"— , and its most important application arc the low density 
parity check error correcting codes^i^. The fully connected p-sp'm model was introduced in2£i21 and now stands at 
the root of the random first order theory of the glass transitio n^^i'^^''^^ . 

In our examples we will mainly use the ensemble of random regular graphs, i.e. Q{1) = S{L — I) and obtain the fully 
connected limit by taking L — >■ oo. The formulas are, however, written mostly for a general degree distribution (with 
a finite second moment). In the cavity equations we often need the excess degree distribution, that is the probability 
distribution of the number of excess edges given one edge is chosen, that is (denoting I the average coordination 
number): 

,(/)^(i±llSl±ll. (3) 



1. Liquid phase: Belief propagation equations 



We now summarize in a very brief manner and without extensive derivations the known cavity equations for the 
XOR-SAT problem as we are going to need them for derivation of the states following method. We are trying the 
keep the equations in the most general form such that generalizations to other models are straightforward. The very 
principle of the cavity method is that we are working with tree-like graphs. Random graphs are locally a tree and 
we thus can work "as if" on a tree (we will eventually have to care of the boundary conditions and precise relation 
to random graphs later on). Solving problem on a tree can be done easily with a recursive procedure that was 
introduced by Bethel. We will, however, use the modern language of computer science, where this is called the Belief 
Propagation (BP) equations. 




FIG. 2: A sketch of the basic cavity recursion in the factor graph representation of XOR-SAT. The square represent the 
constraints involving the product of p spins, while and the circles represent the spin variables . The message passing procedure 
called belief propagation uses messages from constraints to variables (ip) and from variables to constraints (x)- 



For the XOR-SAT problem the BP equations read 

where ^^"^^ and Z'^'^ are normalizations ensuring that V'+l** + "0-1** = 1 s-iid X+i*^ + X^-i" = 1- The quantities 
Xs"^" (resp. V's~^') 3're interpreted in terms of messages being send from a variable i to a constraint a (resp. from 
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constraint b to variable i) (see Fig. [2] for a pictorial representation with the so-called "factor graph".). Message Xs~^" 
is a probability that variable i takes value Si conditioned on constraint a to be missing from the graph. Message V's"^* 
is a probability that the constraint b is satisfied given that variable i takes values st. The recursion could also be 
written with one single type of message as 

{sj} -'' ' jeda\ib£dj\a {sj} 

Given all messages computed on a given graph, one can compute the Bethe estimate of the free energy, which is 
also called the replica symmetric one (RS) free energy: 

-/3F = ^logZ''+^''-^(/,-l)logZ\ (7) 

a i 

where the contributions to the free energy are 

{si} i^da b^di — a 

z\{r^'},p) = n r_T + n i'lT ■ (9) 

Deriving the free energy with respect to the inverse temperature we get the energy 

^ = -m~^^ i'/') = Z^ — TOT^^r^TFf — ff ■ (10) 

"Pa a ^{s,}^ lUedalhedi-aVs, 

All the above equations are written for a given instance (graph, or given instance of the disorder) of the problem. 
It is often desirable to write the BP equations directly in the average form over the graph and disorder ensemble. 
This is the replica symmetric cavity equation 

^(^) = E'?({^'}) / n l['^p(.r)s[i^-Hm,i3)], (11) 

{h} '=1 i=l 

that can be solved numerically via the population dynamics technique introduced ini^ (see also^ or— for details). 

Whether the BP equations for XOR-SAT are solved on a given random graph or in the population dynamics they 
have always the following fixed point that corresponds to the paramagnetic/liquid phase: 

= r-T - xTi" = x^-i" - 1 , (12) 

for all i and a. Plugging this solution in the expression for the free energy we get 

-/3/ = -/3F/7V= -^log(cosh/3)+log2, (13) 



and for the energy we get 



e = i;/A^ = --^tanh;3. (14) 



Hence in this case, the probability that a given constraint is not satisfied is 
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2. Glassy solution: One-step replica symmetry breaking 

The replica symmetric liquid solution from the previous section is asymptotically exact as long as the the point-to- 
set correlation length stays finite^i. This is related to the reconstruction problem on trees^^. When the point-to-set 
correlation length diverges, the replica symmetry broken solutionis has to be used to describe correctly the system. 

In the one-step replica symmetry breaking one splits the phase space into exponentially many Gibbs states, 
pa^i^^a^i^ is then the probability distribution over states of the cavity message ip"'^'^. We now need to consider all 
these states and in order to focus on those with a given free energy / = — Tlog(Z), we weight them according to their 
Boltzmann weight to a given power Z^, where x is the so-called Parisi parameter. In the cavity method x is then 
used as a Legendre parameter in order to select the states with a given free energy. With this in mind, the IRSB 
self-consistent recursive equation reads^Si; 

jeaa\ibeaj\a 

with (3) and Z°-^''-{{-ip''^-'}, (3) being defined in Eq. ©. The Parisi parameter x is indeed a Legendre 

parameter conjugated to the internal free energy of states. The entropy associated with number of states of a given 
internal free energy /, also called complexity and defined by = log (A/'states(/))/-^, can be recovered from the 

following Legendre transform 

-/3x<i>(/3,x)=-/3x/(/3) + !](/), /(/?) = ^^^1^. (17) 
The potential ^{/3,x) is computed from the fixed point of the IRSB equations (fT6|) as 

<i>(/3,x) = ^$'^+^"-^(/,-l)$\ (18) 



where 



e 



Yl Yl dP''^^(^''^*)[Z'^+^''({^''-^'},/3)]^ (19) 

ieda bedi\a 

Yl dP'^^'(V'"^*)[Z*({V'°^*}, /?)]''■ (20) 

aGdi 



The condition for validity of the replica symmetric solution is recovered by solving the IRSB equations for x = 1, 
that is if at X = 1 there exist a non-trivial solution of Eq. (|16p then RS solution is not correct and the phase space 
needs to be divided into states. This happens at the dynamical temperature T^. 

The IRSB solution is then given by the value of x such that 

X* = argmaxJ-/3/(/3) + S(/)|E(/) > 0] . (21) 

Above the Kauzmann temperature Tx one has a;* = 1 and S(/) > 0, that is exponentially many states are relevant 
to the Boltzmann measure. In this phase the local magnetization (marginal probabilities) and the thermodynamic 
potentials, such as the total free energy, are still given by the replica symmetric solution Eqs. p^[T5| . 

Below the Kauzmann temperature x* < 1 and S(/) = 0, the Boltzmann measure is dominated by only a finite 
number of states. However, an exponential numbers of sub-dominant (non-equilibrium) states still exist at any positive 
temperature. 



B. Coloring of graphs, alias the anti-ferromagnet Potts model 

We shall also illustrate some of our results on the anti- ferromagnetic Potts model on random graphs, mostly 
known and studied in its zero temperature version as then it is equivalent to the graph coloring problent^^— . The 
Hamiltonian is 

H= (22) 

where Si are Potts spins taking one of the q possible values (colors), Si,j is the Kroncckcr delta symbol and the sum all 
edges of the graph. The phase diagram of this model at finite temperature is summarized in^ and all the necessary 
equations for both the replica symmetric and glassy solution can be found in^. 
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FIG. 3: (color online) a) Recursive construction of an equilibrium configuration at temperature Te in XOR-SAT. Given the 
tree, and a random choice of interactions (full square J = 1, empty square J = —1), one starts from the root, and chooses 
iteratively the configuration of ancestors (full circles s = 1, empty circle s = — 1) randomly such that it satisfies the constraints 
with probability 1 — ^{Te), Eq. (|15|) . here e = 3/7. Violated constraints have dashed/red borders, b) The problem can also be 
Gauge transformed using Eq. ([29]), see Sec. Ill Fl into a fully polarized configuration with all s = 1 but where the J's are chosen 
from distribution pO|l . 

II. EVOLUTION OF STATES ABOVE THE KAUZMANN TEMPERATURE 

In this section we introduce the states following formalism, and derive equations for the evolution of states that 
are at equilibrium above the Kauzmann temperature, Tg > Tk- In this phase, the paramagnetic replica symmetric 
solution (|12ffT5)) correctly describes all thermodynamic quantities (but misses the ergodicity breaking at Td > Tk)- 
In the next section Hill we give a generalization for equilibrium states below Tk and for meta-stable states. 

In order to get an intuitive idea of what we will do, let us consider the ferromagnetic Ising model on a random graph. 
At low temperature, there are two phases corresponding to the positive and negative magnetization. In order to study 
one of these phases, a good strategy is to first recognize that the random graph is locally a tree. Then one considers a 
tree where all spins on the boundaries are fixed to, say, a value S" = 1, then far away from the boundaries, the system 
will be in the phase of positive magnetization. By changing the temperature the curve m~^{T) can be computed. We 
will follow the same strategy, except that choosing the correct boundaries will be slightly more involved. 

The main idea behind the equations of state following is that we pick a configuration at random among the 
equilibrium ones at a temperature Tg, and then we look at the solution of the belief propagation equations at a 
temperature Ta initialized in that configuration. We will also discuss a special case of factorized replica symmetric 
solution where this idea can be actually performed on a single graph. This is also closely related to the quiet planting 
discussed in^i^. 



A. Gedanken experiment on infinite trees 

Let us consider the problem on a large hyper-tree. Let the hyper-tree have the same distribution of disorder (i.e. 
the degree distribution, the distribution of negations, interaction strengths etc.) as the original problem. Let us 
consider a measure uniform over all configurations having energy corresponding to a given temperature Tg. To sample 
uniformly one configuration from this measure the following steps need to be done: 

(a) Take much larger hyper-tree and start with a random messages on the boundary of the larger hyper-tree and 
iterate the belief propagation equations at temperature Tf, down to the root. This way one created messages 
taken from the replica symmetric solution on the original hyper-tree. 

(b) Assign a value to the root according to the incoming message. Proceed iteratively up to the leaves of the hyper- 
tree with the following: Given the value Si of variable i choose the set of values {sj} according to probability 
P{{sj}\{i^^~'^},l3e,s^) defined in Eq. dH), where a is a descendant of i and b E dj \a for each j £ da\i. 

Now consider the values of variables from the configuration we picked on the leaves. This is a boundary condition 
that defines the equilibrium Gibbs state at temperature Te (as long as Te > Tk)- Next consider the belief propagation 
equations at temperature 7^ Te, initialize the messages on the leaves of the hyper-tree in the configuration we 
picked (i.e. V's = 1 and ipr = for all r 7^ s if we picked value s) and iterate down to the root. The result of these 
iteration does describe properties (free energy, energy, size, overlap) of the Gibbs state at the temperature Ta ^ Te- 
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In case the original temperature was above the dynamical glass temperature, Te > T^, the solution of the belief 
propagation at will not be different from the result of the pure BP at Tq. That is because all the equilibrium 
configurations above Td lie in the same paramagnetic state. 

When the original temperature is below the dynamical glass temperature, Tk < T^, the situation is much 

more interesting. Then the equilibrium configuration we picked lies in one of the exponentially many equilibrium 
Gibbs states and the belief propagation equations at a different temperature do describe adiabatic evolution of that 
Gibbs state. 

In the next subsections wc shall translate the above reasoning into the cavity equations, and describe the population 
dynamics technique used to solve them. 



B. The simplest case: Factorized RS solution. 



The simplest form of the equations for adiabatic evolution of states can be written when the replica symmetric 
solution is factorized, i.e. when the values of the messages are the same. This is the case in the XOR-SAT problem 
where there is a BP fixed point in which for all i and a the message ip"'^^ — 1/2. Furthermore, this fixed point gives 
an asymptotically exact results above the Kauzmann temperature Tk- 

When the RS solution is factorized the step (a) in the construction of the equilibrium configuration can be skipped 
and the probabilities P{{sj}\{ip^^^, (3^, Si) depend only on the values of variables and the inverse temperature Pe- 
In the XOR-SAT in particular we have from ([6]) 

/^e,. ^^3, (23) 

Meaning that a clause is unsatisfied with probability e(/3e) given by ([TSl) . These probabilities are used according to step 
(b) to choose an equilibrium configuration on the hyper-tree. Then belief propagation equations at a temperature Ta 
are initialized on the leaves in that configuration and iterated. As usual for belief propagation equations a probability 
distribution of the values of messages can be written. This time one has to distinguish between messages sent to the 
variables which were assigned value -1-1 in the equilibrium configuration, and those that were assigned —1. Given 
the probabilities to choose values of variables (|23p . the two probability distributions have to satisfy the following 
self-consistent equation 

s 11 S' r K—i li 

PsW - E E E 2^'-i cosh/3e J / n Y['^P^'(^')S[^-H{^'},l3a)], (24) 

J {h} {si} ^ '=1 i=i 

where (^({^i}) is the excess degree distribution, and /3a) is defined in (0). Note the use of inverse temperature 

/3a in the BP equations represented by the delta function. Given a Gibbs state that is one of the equilibrium ones at 
temperature Te, Eq. (j24p encode its properties when the temperature is changed to Ta. 

The learned reader will have recognize that, when Tg = Ta, this is nothing but the IRSB equation^^ (at Parisi 
parameter x = 1). This is actually quite normal, since when the two temperatures are equal, we are just describing 
the properties of a typical state, which is what the IRSB method does. Similar equations when the temperatures are 
equals were thus considered in many works^ii^i^i^. 

To solve Eq. (|24p with the population dynamics we represent Ps{ip) by an array of values for each value of s. To 
update one element in the array Pg wc first pick degrees k from the excess degree distribution, then based on value of 
s and Eq. (|23p we pick the values {si}. After that, for each i we pick li random elements in the array Ps- and based 
on ^ we compute a new value of ip and replace one element in the array Ps- We repeat many times until (based on 
computation of some average quantities) the convergence is reached. It is also important to note that the initial state 
of the populations corresponding to the boundary conditions on the hyper-tree is 



(o. 



(25) 



The internal Bethe free energy of the state is 

, , i^cosh^" . 

E2(0^E / ri WpIA^% logZ'({^'},/3a). (26) 



/3a/(/3a) = «EQ('^)Eg(W)E 2^cOsh;3eJ / 11 IT t^^' (^'^ )] ^"^""^ ( }' Z^-^) 
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The value can be computed using a population dynamics procedure based on the fixed point for Eq. (|24p . 



C. The case of a general (non-factorized) RS solution 



In a general case when the replica solution is not factorized, e.g. in the canonical case of the random K-SAT 
problem, the situation is a bit more complex. In the gendanken experiment of section III Al the uniform boundary 
conditions have been created with (and thus depends on) the replica symmetric marginals ijj. The procedure described 
in the gedanken experiment translates to a more general form of equations, that are exact on a tree. The equivalent 
of cq. ([24| then reads 

J {1} ■' 1=1 J=l 

{s.} Z{{i' J i=l j = l 

where C(J, s, {si}) is an arbitrary interaction between spins s, {s^} of "strength" J, in case of XOR-SAT we had 
C(J, s, {si}) = J Pc-sW^Si. This equation is maybe easier to understand from the population dynamics procedure 
used to solve it. Now we have |s| + 1 different arrays to represent the messages. In the first array we initially put 
an equilibrated replica symmetric population (values obtained by solving the simple RS equations by population 
dynamics). In the array corresponding to value s we initially put a message completely polarized in the direction s. 

Updating one element have to be done in all the |s| + 1 arrays simultaneously. One first chooses the degrees Z^, then 
one chooses the corresponding number of random elements in the population. One uses the first array to compute 
the new value corresponding to the first array in the new element. To compute a new value corresponding to array s 
one uses the values on the first array to draw a configuration of values {s;} using probabilities 

p{{sm'},Pe.s) = efec(xM..}) nti'n;-'=i?.. ^^^^ 

^(W },/3e) 

Finally using elements in arrays corresponding to values Si one computes a new value. This done for every value of 
s finalizes one step. All is repeated until convergence is reached. The expression for the free energy is analogous to 
(PS)) using the same generalization as for ((?7)) . 

We note that when Pe = Pai the above equations arc actually already known, and are exactly equivalent to the 
IRSB equations at a; = 1. Again, this is just because in that case, we are just describing the properties of a typical 
state. With equal temperatures the above form of the IRSB equations at a; = 1 appeared i n^s, 50^51 ^^-^ .^^jjjc}]^ -^^ refer 
the reader interested to see how the present derivation generalizes) and similar equations appeared in the context of 
the analysis of an idealized BP decimation algorithms 



D. The relation to the problem of reconstruction on trees 



In the special case when Tg = Ta the above equations are thus equivalent to the IRSB equations when the Parisi 
parameter x = 1, and are closely related to the problem of reconstruction of trees, an important setting in computer 
science and information theory, as was first realized by Mezard and Montanari^^. 

In the reconstruction on trees, a single (configuration) is spread from the root of the tree to its leaves with some 
given rules and noise level, and the task is then to reconstruct (infer) the value of the root based on the configuration 
on the leaves. In particular in a model with a factorized replica symmetric solution, constructing an equilibrium 
configuration on the tree has a simple local interpretation, as e.g. in2^. The noise level corresponds to the equilibrium 
temperature Tp. This spreading construction is precisely the one we have used in Fig. [3] for the XOR-SAT problem: 
starting from a value of the spin chosen randomly, we have chosen iteratively the configuration of the other variables 
randomly such that it violates the constraints with probability e, corresponding to Tg. 

In the reconstructing on trees one thus applies BP starting form the leaves, using the values on the boundaries as 
starting conditions, to generate the marginal distributions of the variables within the tree. This is precisely what we 
have done, the only difference is that in the reconstruction formalism, one knows the value of e that has been used in 
order to construct the configuration on the tree, and therefore, one used the same value in the BP equation in the 
recovery process. 
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The states following problem is thus a generalization of the reconstruction on trees, where one first generates the 
configuration with a value (corresponding to a temperature Tg) but then apply the BP equation with a different 
value Ca (corresponding to a temperature Ta). 

1. Reconstruction in a noisy channel without knowledge of the noise 

The method of states following can thus be viewed as a variant of reconstruction on trees. In this interpretation the 
noise of the channel is described by the inverse temperature /3e- If this value is unknown, the task of reconstructing 
the values will be done with an priori different temperature (3a'- The behavior of equations (j24p thus describe the 
reconstruction problem where the noise level of the channel is not known. 

Two interesting remarks can be done at this point. First, it follow from the maximum likelihood principle that the 
best chance to reconstruct corresponds to /3e = /3a, and in fact, this give a direct way to recover the noise value by 
maximizing the free energy: On a tree, both the noise value and the marginal distribution can thus be recovered in 
the reconstruction process. A second point is that, as wc will sec from the behavior of the states following method, in 
some cases although reconstruction is possible at (3a = (3e it might not be possible at some (3a > Pe (that is when trying 
to reconstruct by assuming the number of mistake smaller than the actual value), which is rather counterintuitive. 

2. A new hound for noisy reconstruction 

A last point we shall mention is that out method provides a simple way to have new bounds on noisy reconstruction. 
Consider indeed a problem where we have generated the boundaries with a noise level (3,, . We now use a very simple 
algorithm: we simply do the BP recursion with (3a — > oo, that is, assuming that no mistakes were done in the process. 
In that case, a simple bound of the reconstruction threshold can be obtained by considering a probability when the 
boundary condition directly imply the correct value of the roo t^^'^^ . A similar procedure for = was called naive 
reconstruction in^i^. 

In the case (3a ^ oo the equations simplify and can be cast in a set of coupled equations with two variables variables 
- one being the probability that the value of the root is implied in the actual value, second being the probability that 
the value is implied wrongly. As long as the first probability is larger than the second, which is always the case in 
the cases we studies, this leads to new bounds on the noisy reconstruction problem. Some of these values are given 
in Sec. IV CI for the XOR-SAT problem. In fact, it is simply the generalization of the naive reconstruction bound to 
the case of noisy channels^i^. 

E. Quiet planting: How to simulate impossible to simulate models? 

The construction we have described in this section is related to the notion of quiet planting, which turns out to be 
a powerful way to perform simulations for the mean field models, that would not be possible otherwise. 

Let us first stress that the thought experiment of choosing an equilibrium configuration, that lead us to the derivation 
on above equations, is feasible only on trees. On a random graph we would encounter problems as soon as the long 
cycles would start appearing when proceeding from a node playing the role of the root. Indeed, choosing an equilibrium 
configuration on a given random graph below the dynamical temperature Td requires as far as we know an exponential 
time. 

This difficulty, however, can be bypassed in the special cases where the replica symmetric solution is factorized and 
in this case the adiabatic evolution of states is realizable also on a single graph instances and this has interesting 
algorithmic applications: it is possible to create a graph and an equilibrated configuration at the same time. The 
point is that when the RS solution is factorized it is possible to create a typical random graph (from the ensemble 
under consideration) and a configuration that is an equilibrium configuration at temperature Tg > Tk on that graph. 
This concept was called "quiet planting" and was discussed by the authors in^L^. 

Let us first define quiet planting in the XOR-SAT problem and then justify the above claimed properties. Plant- 
ing an equilibrium configuration in XOR-SAT at a given temperature (or equivalently at a given energy) works as 
follows: First choose a random configuration of spins {ci}, then choose a random instance from the ensemble under 
consideration restricted to the fact that (1 — e)M constraints are satisfied by the chosen configuration of spins and 
cM are not satisfied. Thus, given the configuration, choose at random eM ((1 — e)AI resp.) constraints out of all 
the possible satisfied (unsatisfied rcsp.) constraints. The fraction e is a function of the temperature (3^, and it is 
given by Eq. (fTS)) . This way for one given clause, out of the 2^~^ configurations that do not satisfy that clause each 
will happen with probability e/2^~^, each satisfying configurations will appear with probability (1 — e)/2^~^. If we 
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condition on the value of one variable contained in the clause we obtain probabilities ((23)) . Thus if we look on a finite 
neighborhood of a variable in a very large planted hyper-graph we will obtain a hyper-tree statistically identical to 
the one described in section Hi Al Consequently, Eq. (|24| and ([26|) are the cavity equations describing the properties 
of the planted graph. As typical properties of the graph follow from the solution of Eq. the planted graph and 
the planted configuration will have the same typical properties as a random graph and an equilibrium configuration. 
Hence, justification of the name "quiet" planting, i.e. planting that does not change properties of the ensemble. 

Note here that the above argument was possible only because the probabilities were independent of the values 
of messages {ip''^^}. On the other hand, whenever this is the case, i.e. whenever the replica solution is factorized, 
the above argument is valid. In a general factorized case, i.e. for non-symmetric interactions or when disorder in the 
interactions is present, the planting procedure have to be slightly generalized. The marginal probabilities are used to 
plant a configuration with a proper number of each value (proper magnetization). Based on the RS solution one has 
to compute probabilities that a given type of constraint has given set of values on its neighboring variables and plant 
the constraints accordingly. An example of this general procedure at zero temperature was described in detail in^. 

It shall be noted at this point that the equivalence between the planted and purely random ensemble has been 
proven rigorously in^ in the zero temperature case in the region of parameters where the second moment of the 
number of solutions is smaller than some constant times the square of the first moment. E.g. in the coloring problem 
for 3 colors the above holds till average degree Cq(3) — 3.83, for 4 colors until Cg(4) ~ 7.81, to be compared with the 
Kauzmann transition, also called the condensation transition, Cc(3) = 4 and Cc(4) = 8.46. In the factorized models 
the annealed free energy, log(Z), starts to differ from the quenched one (logZ) at the Kauzmann transition^, and 
then the equivalence between the two ensembles breaks down. 

Even before the proofs the equivalence between the planted and random ensemble for XOR-SAT for connectiv- 
ities below the condensation transition was proven inSi^ appendix A. In this special case the equality of the annealed 
and quenched free energies is directly linked to the absence of hyper-loops in the graph^i. Authors o:^ used the 
equivalence between the planted and random ensembles and the fact that the planted configuration is one of the 
equilibrium configurations as a handy tool to "equilibrate" their Monte-Carlo simulations even at temperature where 
the usual equilibration is impossible in feasible times. 

The fact of generating for free an equilibrium configuration together with a typical realization of the disorder for 
all temperature T > Tk is extremely useful, and allows to perform simulation that would be impossible otherwise: 
indeed for all the range of temperatures Tx < ^ < T^, it is unfeasible to find an equilibrium configuration as soon as 

is not ridiculously small. With the new method, this limitation disappears! The present authors have already used 
this in^i^, where one benefited from the fact that Monte Carlo, belief propagation and other dynamical procedures 
can be initialized in a truly equilibrium configuration. Later on, in section |Vl we will use this trick of quiet planting 
to confirm numerically, through Monte-Carlo simulations, the results of the states following method. 



F. Reformulation using mapping on the Nishimori line 

A last, and maybe the most striking, relation to previous works arise when one considers Gauge transformations. 
Let us consider, again, the p-spin model. The equations for adiabatic evolution of states can be further simplified by 
exploiting a Gauge invariance. Indeed for any spin i, the transformation 

Si — > —Si and Ja — > — Ja Va G di (29) 

keeps the Hamiltonian Eq. ^ invariant. As shown in Fig.|31 this allows to transform the equilibrium spin configuration 
on any graph into a uniform one (all ,s — 1), the disorder distribution then changes from ^ with p = 1/2 to 

Onl( J) = e(Te)(5( J + 1) + [1 - e(re)](5(J - 1) , (30) 

where e(Te) is given by Since all s = 1, there is no need to distinguish between the -f 1 and the —1 sites. Eq. ([M]) 
reduces to the usual replica symmetric cavity equation for a problem with mixed fcrromagnctic/anti-ferromagnetic 
interactions at temperature Ta initialized in the uniformly positive state 

P,(V')=^gNL(J)^9({?J) / n l[dPii^')S[lb~Ti{r},M], Piniti^)=S 

{U} *=i J=i 

The distribution of interactions ((30|) is given by the Nishimori-like^Si^ relation between temperature Tg and density 
of anti-ferromagnetic couplings e, and arises because at Ta = T^. the overlap with the equilibrium configuration, playing 
a role of magnetization m in the Gauge transformed model, is equal to the overlap q between two typical configurations 
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from the state, a well known properties on the so-ealled Nishimori line (that is the line defined by the Nishimori relation 
in the temperature/ferromagnetic bias plane). 

The Gauge invariance have thus transformed the task of following an equilibrium state in a glassy model into 
describing the evolution of the ferromagnetic state in a ferromagnetically biased model with the standard cavity 
approach. As we will derive in Sec. IIV 5] adiabatic evolution of states in the fully connected p-spin model for > Tk 
is thus equivalent to solving the p-spin model with an additional effective ferromagnetic coupling (|52|) . and one can 
thus readily take the solution of the p-spin in the literature, e.gi^i^, to obtain properties of equilibrium states. 

Similar mapping exist for all mean field models where the replica symmetric solution is factorized (see for instance^ 
for glassy Potts models), however, the resulting model is not always very natural nor already known. For the p-spin 
model the evolution of a glassy state being equivalent to melting of the ferromagnetic state on the Nishimori line has 
deep consequences for the physics of glasses, as will be discussed elsewhere^. 



III. EVOLUTION OF STATES: GENERAL CAVITY EQUATIONS FOR ANY TEMPERATURE 

In this section we introduce a method of states following that is suitable at any temperature, and where replica 
symmetry breaking is thus taken into account. The method is set for any general IRSB states, at any value of the 
Parisi parameter x and any temperature, as long as the corresponding states are stable towards further steps of replica 
symmetry breaking. Stability of the following equations towards RSB for different values of j3a is interesting and will 
be discussed later. 



A. Adiabatic evolution of IRSB states 



In order to understand the general equations for the adiabatic evolution of states, let us first briefly recall how are 
derived the cavity IRSB equations that describe the equilibrium states. We work at inverse temperature /3e where 
many states exist, each of them has a corresponding BP fixed point, i.e. a message ip on each link. As described in 
Sec. II A 21 the IRSB method uses the distribution of messages P{'ip,/3e) over all states with a given free energy /. 
In order to select the free energy, we consider the BP recursion in every possible state, but we reweight each state 
according to the Boltzmann weight Z^{ip,f3e). This leads to Eq. ([T51) . 

One intuitive way to understand Eq. (jl6p is to think about the problem on a tree and consider many possible 
boundary conditions Pinit{tjj, Pe)- In order to select boundary conditions that lead to the state of free energy / we 
reweight P{ip, /3e) at each steps with the Boltzmann weight Z^^ijj, jSe). Eventually, for different x such fixed point will 
describe states with different free energy /. For more details on this derivation seei^i'^'^. 

In order to write the equations for the adiabatic evolution of the IRSB states, we first need to describe the state via 
Eq. (jl6p . and second we use another distribution P{ij}, ip) that describes the same state at a new temperature Pa- The 
equilibrium states at temperature /3e arise if one uses the reweigthing Z'^{ip, /3e). The probability distribution P{ip, ^i) 
thus needs to be rcwcighted with the same factor Z^{ip,Pe) in the state following method. Thus, the generalization 
of the IRSB equations to the state following is a recursion on both P(-(/;,-0) and P{tp,'ip) as follows 

p'^^\r^\r^^) ^ I fH n dp''"'(^'"''^''"') [^""'(w'^^'i^/^e)]' 

S[r^^ - J-({V'^n, Pe)] 6[r^'' - I3a)] ■ (32) 

The distribution P is initialized as 

P''^\il;<'~'\ ^''^') = P°-^'{^''^') 5{il:°-^' ~ V^"-"') , (33) 

where the p'»^*(^''^«) is the solution of the usual IRSB equations ([T6l) describing the equilibrium state at an inverse 
temperature /3e. Equation p2p then describes adiabatic evolution of this state at an inverse temperature Pa- Note 
that the reweighting factor Z^ comes from the messages -0 as the inverse temperature /3e - again, this is the key 
element assuring that we are looking into the same state at a different temperature. 

The internal free energy of the state at temperature Pa is given in terms of node and link contributions, as usual in 
the IRSB cavity method: 

- PaFiPa) = -Pa ^ F'^'^^^iM + PaY.{k ' l)F\Pa) , (34) 
a i 
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where 



I Hieda n 



ilbedi\a 



^pb^^[^b^\^b^'^) logZ"+^"({Vi^^'},/3a) [Z'^+^"({7/^^^'},/3e)]' 



And for the corresponding energy we have 



(35) 
(36) 

(37) 



Eqs. p2ll37p are written for a given instance of the problem. It is instructive to describe how to solve them on 
average over the graph ensemble using the population dynamics methodic. We need to keep a population (representing 
the average over graph) of couples of messages (one for ip, the other for ip). Then the population is iterated in the 
exact same way as in the usual case^^, the whole population of couples is reweighted using the reweighting factor 
[^■Q+aa^l^b^^l^^^-jjx computed from the elements at inverse temperature (3e- 



B. When states themselves divide into states 



So far we supposed that the state we are following does not exhibit an instability towards replica symmetry breaking. 
This assumption may break when temperature Ta is low enough. To check for the local stability we can use a variant 
of any known method, see e.gi^ or appendix C of^. One of the methods simplest to implement in the population 
dynamics is the monitoring of deviation of two replicas. For that we first need to find an equilibrated population at 
a temperature Ta, then wc copy this population and introduce a small noise. Further the two copies (replicas) are 
updated with the same random choices and the deviation of the two is monitored. If the deviation is going to zero 
the state is locally stable, if the deviation is growing the state is not stable towards replica symmetry breaking, that 
is the state has the tendency to divide into many smaller states. This second case can be treated in the following way. 

If the state to be followed is not stable towards replica symmetry breaking then applying the IRSB method within 
this state shall lead better result about its behavior. The following equations together with (|16l32p describes the 
method 

pa^.(pa^,) = _L_ / n n dP^^'iP'^') [Z'^^\l3e,l3a)r ^ [^""'' " MiP'^' } , f3e, Pa)] , (38) 
2 ]eda\ibedj\a 

where the functional J^2{{P''~^^'}^ l^e: f^a) is define by Eq. ((32|) . Said in words on every edge next to the population 
corresponding to Eq. (|16p one would have to keep a population of populations, each corresponding to a sub-state. 
Each of these populations would be reweighted using the reweighting from Eq. (|16p . A second reweighting with Parisi 
parameter X2 would have to be done on the level of populations. On top of all that in the non-factorized cases a 
population of these object would have to be kept to account for the average over the graph. Numerical resolution of 
such equations becomes involved and we let their implementation for the diluted models for future works. 



IV. FIRST APPLICATION: ADIABATIC EVOLUTION OF STATES IN THE FULLY CONNECTED 

p-SPIN MODEL 

Now that we have presented the method for adiabatic evolution of states, let us show how does the solution of the 
equations behave and what can be learned about the physics of the p-spin problem. We will also describe here the 
connection of the states following method to the Franz-Parisi potential^li^ and with the physics on the Nishimori 
line. 

One of the simplest cases to which Eq. ((24)) can be applied is the fully connected p-spin model. The static replica 
solution of the model is iit^l. In appendix |A] we show how to re-derive the replica symmetric equations for the fully 
connected p-spin model as a limit of infinite connectivity of the cavity (belief propagation) equation (|24p. Here we 
only summarize the equations needed to explain how to obtain the solution for state following. 
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A. The equilibrium solution of the fully connected p-spin model 

As discussed in details in appendix |^ BP simplifies in the fully connected model where the amplitudes of all 
interactions are small, and become 



^ tanh /3 XI n 



(39) 



where m the local cavity magnetization. The replica symmetric solution can then be written in terms of the distribution 
of such cavity magnetization that are Gaussian because of the central limit theore m^^'^^ : we thus need only the average 
magnetization m = (m*^") and the average overlap between configuration q = ((m*^")^). The recursion reads: 



m 



Vy tanh {jiJy^J pqP-^ /2 + pjopmP^'^ 
Pytanh^ {j3Jy^/pqP~^/2 + pJopmP'^^ , 



(40) 
(41) 



where we call Dy = dy e 2 / v27r the Gaussian integration. The free energy is a function of the fixed point of the 
above equations: 

-/?/= J/3V2(p-l)gf-/3Jo(p-l)mP+i/3V2-l/3V2pqf-i+ j 2?ylog2cosh i^^Jy^pqP-^ /2 + pj^pm^^^) , (42) 



and for the replica symmetric energy density we have 



Jomf--(3j\l~qP). 



(43) 



The IRSB solution with the value of Parisi parameter x is obtained in a similar way, and the corresponding fixed 
point equations are 



Vu 



Vu 



Vu 



J Vv cosh"^ {I3G) tanh (/3G) 



JVv cosif ipG) 

JVv cosh"^ {I3G) tanh^ (^G) 
JVv cosh^ {(3G) 

/ Vv cosh"^ (/3G) tanh {(3G) 



JVv cosh^ (/3G) 



where 



G = Ju\ 7:qo ^ + JvJ^ql 



-1 P p-i 



Jopm 



p-i 



(44) 
(45) 
(46) 

(47) 



is a sum of two Gaussian variables, and V is the Gaussian integral. The parameter qi is the average self-overlap and 
go the average overlap between states. The IRSB Parisi (replicated) free energy reads 



/3x^{/3,x) = -x/3JopmP + J(l - x)x{p ~ 1)13^ J^q^ + ^x^ {p - 1) p'^ J'^ q^ + ^/3''j''x - ^p'J'^xpql 



+ a; log 2 + j Vu log j Vv cosh"^ /3G , 
the free energy is derived as /(/?) = d^{f3,x)/dx. 



(48) 



B. Equations for adiabatic evolution of states for Te > Tk 



Let us give a derivation of state following equations for the fully connected p-spin model using the equivalence 
with the planted ensemble. We think about the fully connected model as the large connectivity version of the diluted 
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model and used the planting procedure described in sec. Ill El We first plant an equilibrium configuration at inverse 
temperature /3e, then initialize the belief propagation equations in this solution and iterate to a fixed point at another 
inverse temperature j3a. When the temperature of planting is larger than the Kauzmann temperature, /3e < Pk^ then 
the planting can be done in a very natural way. One first takes the replica symmetric energy at /?£ and computes 
the corresponding fraction e of interactions that are not satisfied at that energy. Then when constructing the planted 
graph one first chooses a random configuration, the sign of interactions is then chosen in such a way that fraction e 
of them is unsatisfied and 1 — e satisfied. 

The value of e in the fully connected p-spin model is computed as follows. Let us assume Jq ~ 0, as this is really the 
case wc are interested in, recall that we rescale the interactions in the fully connected model as ( J^) = J'^pl/{2NP~-^), 
hence Ja = ±J yJp\/{2NP~^), there is total of NP/p\ interactions. The energy we want to achieve is given by (j43p . 
hence e has to satisfy 



1 j(i - qn / P! 

'=2-^^ 2 V^^- ^^^^ 

Moreover as wc consider only {3^ < in the p-spin model this means that q = 0. 

Now let us keep in mind the above planting, moreover consider that spin i was planted +1 (without loss of 
generality) and look back at equation p9p . considering Jq = 0. The terms in the sum in the argument of the tanh 
are independent (by the assumption of replica symmetry within the planted state) and their statistics is thus ruled 
by the central limit theorem. Thus our aim is to compute the mean and variance of the argument. If the interactions 
would not be correlated with the planted configuration the mean would be zero (remind we have Jq = 0). If we satisfy 
every interactio n wit h probability 1 — e, there will be 1 — 2e more satisfied interactions that unsatisfied ones. These 
1 — 2e = 2/3eJ \/pl/S/N''P~^'>/^ interactions are biasing spin i in the direction +1. The mean of the argument of the 
tanh is thus 



^ = ip-iy. '^(p"^ /^"^'" - ^" P.jVWSjj^mr'-^ = P. Wl2\pmP--. (50) 

The planting only influences the directions of the interactions, thus in the variance computation nothing changes and 
we have again 

a-/32j2pqf-V2. (51) 

Thus parameters m = (m*^"). and q ~ ((m*~^")^) are ruled again by equations (j40ll41l) with inverse temperature 
and effective coupling 

Jo^« = /3eJV2. (52) 

Parameter m now measures how far from the equilibrium planted configuration is a typical configuration at /3a. Also 
the free energy equation (|^^ applies to this case with inverse temperature Pa and effective given by ([5^ . The 
free energy here is, however, free energy of the planted state and thus the complexity, defined by (jl7p with a; = 1, can 
be computed considering the difference 

S = -/3a/( Jo = 0) + Pa!{ jf) ■ (53) 

Consequently all the physics of adiabatic evolution of states above the Kauzmann temperature for the Jq = model 
can be induced from the known phase diagram of the Jq ^ model and Eq. (|52|) is the Nishimori line conditional^ 
for the fully connected p-spin model with a nonzero Jq: This illustrates the general equivalence we have discussed in 
Sec. Ill FI between the states following method and the original model on the Nishimori line. 

The dynamical temperature can be interpreted as the spinodal point of the planted state, thus at Td we start to have 
a nontrivial solution if /3e = Pa- And at Tk the complexity ((53)) becomes negative at Pe = Pa- Iterating Eqs. (|40ll4ip 
we indeed obtain values of the two critical temperatures as known from the IRSB solution of the p-spin model. For 
p = 3 we have Tk = 0.6513 and Td = 0.6815. 

In the case of fully connected p-spin model the state following when they start to be unstable (divide into sub- 
states), described in generality in Sec. IIIIBl can be done easily (at least on the IRSB level) by using the mapping on 
a model with effective ferromagnetic coupling. Again, for the model with Jq = the IRSB solution inside a state is 
equivalent to the standard IRSB solution in a model with jf = PeJ^/2, Eqs. (011111). 
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C. Equations for adiabatic evolution of states for Te < Tk 



We now want to follow states below the Kauzmann temperature, or metastable states above Tk (i.e. at a Parisi 
parameter x ^ \). As far as we know there is no "planting" interpretation for this case, the mapping into ferromag- 
netically biased model on the Nishimori line does not work either in this case. The underlying equilibrium measure 
at Te < Tk become more complicated, the derivation then must follow by rewriting equations (|16l32p in the large 
connectivity limit. 

For simplification wc note that in the p-spin model with Jo = wc have m = (70 = thus the only non-trivial 
parameter describing the IRSB state we aim to follow is gi, given by the equation ps)) . this summarizes Eq. ([T| 
To rewrite Eq. p2p we need to introduce overlap qi and a correlation between the two populations 



gi = / VQ{P) 
VQ{P) 



J dP(m'^°) Z({to^^°}, /3e)^ 



((to to , 



p,p/ 



(54) 
(55) 



In appendix I A 31 we remind the derivation of the standard IRSB equations for the fully connected p-spin model. What 
we nee here goes in a very similar manner. We define 



X 



E n 



X 



b^di\a j^db\i 

and obtain similarly as in appendix lA 31 



E n 

b^di\a jGdb\i 



p 



■iV ~p-i 
— a 
2 



{{XX)p^p)q 



(71 (Tl 



The final self-consistent equations for qi and c are then 

/ V{u, v} cosh"" (Pev) tanh^ (^a") 
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J v} cosh^ {f3ev) tanh {I3ev) tanh {f3au) 
/ Vv cosh"" (Pev) 



where 



V{u,v} 
Vv 



27rtTitTi a/1 — p2 



exp 



V 2pu V 

2(1 -p2) ^^2- + ^-^ 



du dv . 



1 



(JiV 27r 



cxp 



2al 



dv . 



(56) 



(57) 
(58) 

(59) 



(60) 
(61) 

(62) 
(63) 



The free energy of the followed state can be obtained by plugging expressions (|A18p and (|A10p into p5ll36p and 
getting 



/3e 



1 



1 



/ Vju, v} cosh^ (Pev) log [2 cosh j/Sgu)] 



J Vv cosh"' (p^v) 



(64) 



The energy is then obtained by deriving e ~ d{/3af)/dPa- Again, these equation are similar to standard replica 
equation with a kind ferromagnetic bias, but do not have as simple form as was given by the mapping on Nishimori 
line for T^>Tk. 
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D. What happens when one follows states: Turning cartoons into data 



So far we were describing ideas and the formalism for the method of adiabatic foUowing of Gibbs states. In the 
remaining subsections we describe and discuss results which can be obtained about the energy landscape and the 
structure of states for the fully connected p-spin model, based on the previously derived equations. 

One obvious application of the states following method is to compute how does the energy of equilibrium states 
evolve with temperature. Such energy-temperature diagrams (volume or entropy is sometimes plotted on the y-axes, 
or density is plotted as a function of the pressure) appear in many works about glassy systems^S^ for recent examples 
gg Q63,64 ^ Except for a few very simplistic models such as the spherical p-spin models^s^ii, the random energy or 
random entropy model^ or the random subcube model^. (where the dynamics is exactly solvable), all these diagrams 
were drawn as qualitative schemes, or as results of Monte-Carlo simulations. Moreover, in the field of glassy dynamics, 
the energy landscape is often cartooned by drawing many valleys of different sizes and depths. The states following 
method allows to draw the above mentioned figures with actual quantitative data for any model solvable via the cavity 
or replica method. 
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FIG. 4: (color online): Adiabatic evolution of states in the fully connected 3-spin model, where Td = 0.6815 . . . and Tk ~ 
0.6513 .... The continuous blue curve shows the equilibrium energy e^{T) of the model versus the temperature (with the Gardner 
transition towards full RSB phase at low temperature). We have applied the states following method and the red curves (five 
roughly parallel curves) mark the adiabatic evolution of states from equilibrium with Te — 0.6815, 0.675, 0.67, 0.66, 0.6513 for 
temperatures Ta 7^ Te. Left: This is the RS result where we follow states using the RS ansatz, Eqs. (|40II41(I and (|43|l . Upon 
warming, the states exist until meeting a spinodal point at much larger temperature. Upon cooling the states can be followed 
until they become unstable against IRSB (dashed), eventually a non-physical spinodal point makes the RS solution vanish. 
Note that the equilibrium state at Te = Td vanishes as soon as Ta < Te and is thus not even seen on this picture. Right: 
We follow states using the IRSB ansatz (the dashed part of the red curves), Eqs. (|44j|48p . The IRSB solution is actually also 
unstable to further steps of RSB and (most probably) the full RSB should be used instead. The IRSB is therefore a (good) 
lower bound to the correct result. Note also that the non-physical spinodal points for low temperatures do not appear and 
that the IRSB approach has mostly cured the problem, with the exception of the states corresponding to Te « Td- The green 
dotted line is an example of a region where even the IRSB equations do not have a physical solution. The green dotted line is 
a lower bound computed by the construction suggested in Sec. IIV G 21 



The left part of Fig. 2] shows how does the energy of states depend on the temperature Ta. The blue line is the 
equilibrium energy of the system at a given temperature. This curve is divided into four parts, the part above the 
dynamical temperature Td represents a high temperature liquid phase. Between the dynamical Td and Kauzmann Tk 
temperature is the dynamical glass phase, where the free energy or energy are still given by the liquid result, but the 
equilibrium state is divided into exponentially many Gibbs states. Below the Kauzmann temperature Tk the static 
line is obtained by solving the IRSB equations (|44ll48p . at this point its derivative changes discontinuously. This 
IRSB solution becomes unstable below the Gardner temperature Tcr^^ below which the line is dashed, as it is no 
longer exact, the correct FRSB energy would be higher. 

Each of the red lines (five roughly parallel lines crossing the figure) is obtained by following the evolution of one of 
the exponentially many states equilibrium at some Tk < Te < Td- When the state is heated the energy grows up to 
a spinodal point where the state disappears, i.e. when the only solution of equations (|40ll4ip with Jq given by ([5^ 
has m = 0. As Te approaches Td the spinodal point is at lower and lower temperatures, states very near to Td are 
lost almost immediately when heated. This is an interesting result as in the spherical models, the state at Td could 



19 



be heated to much larger temperature: that is an unphysical property of the spherical model that disappears in the 
Ising model we have considered here. 

When the state is cooled down, the energy is decreasing, but slower than the equilibrium energy. As soon as the 
temperature changes the state goes out of equilibrium: this corresponds to the notion of glassy states trapping the 
dynamics up in the energy landscape. In Fig. |4] left we plotted the energy of states supposing they are stable against 
replica symmetry breaking. We found, however, that this was not always the case and thus denoted the unstable, 
thus unphysical, part of the curves by dashing. Indeed, the dashed part of the lowest state curve even crosses the 
equilibrium line, which is unphysical, a clear sign that the replica symmetry is broken. The left ends of the red lines 
(five roughly parallel lines) correspond to another spinodal point, in the sense that the non-trivial, m 7^ 0, solution 
of the RS state following equations (|40j|4ip ceases to exist. This spinodal point does, however, not have a physical 
interpretation, as the states are unstable towards RSB in that region. We will see in Sec. IIVFI that this unphysical 
spinodal is related to a known problem in the spin-glass with ferromagnetic bias. 

The right hand side of Fig. |4] depicts the same quantities as the left hand side, the difference is that for the adiabatic 
evolution of states we used the IRSB equations ()44ll48p . The part where this changes the result is distinguished by 
dashing. We checked that even the IRSB description of the states is not stable towards more step of RSB, so that 
the exact description of the dashed parts requires a full RSB solution. The IRSB result, however, gives a much better 
— and physical — approximation of the correct behavior. Still, for the upper states a non-physical spinodal point 
remains; this can be seen on the highest red curve when its dashed part finishes and turns into dotted green, we will 
describe in Sec. IIV G 21 how the green dotted line was obtained. Obtaining the FRSB is only a technical problem of 
solving the corresponding equations as the mapping to the partly ferromagnetic model (j52p is valid on any level of 
RSB. 

Note that our results correspond well to the solution of the dynamical equations in the spherical approximation, 
where indeed the transition towards more steps of replica symmetry breaking was observed^: we expect actually 
this behavior to be quite universal and to be observed in any spin glass model with an IRSB equilibrium solution. 

One comment is in order here. The reader familiar with the phenomenology of the p-spin model will certainly find 
many similarities between our results and the one advocated iii^. In that work, the authors considered like us the 
states that are at higher free energies than the equilibrium ones for a given temperature T, and found that at high 
energies these states are always unstable towards FRSB, just as we see in Fig. IIV G 21 There is, however, a major 
difference between our works: in^ the authors were looking at the typical excited states at a given free energy / and 
temperature T, that is, at the most numerous ones. In our present work we instead concentrate on following the 
states that were typical at a given temperature. The point is that as soon as the temperature is changed, these states 
become out of equilibrium and not typical. If one wants to focus on the states that are the most important ones for 
the free energy landscape, it is necessary to consider their basins of attraction, as we do, and this is why we have 
developed the following state method in the first place. We will come back on this point when we will discuss the 
iso-complexity problem in Sec. IV CI 
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FIG. 5: (color online): A direct quantitative look at the shape of states in the energy landscape of the fully connected 3-spin 
model. The energy of four different states is plotted as a function of their entropy; we plot s/2 and —s/2 such that the width 
corresponds to the entropy. The shape of the curves show how the valleys looks in the energy landscape. The most outer 
curve (blue) is the total equilibrium energy versus entropy. The four inside red curves correspond to different states that are 
at equilibrium at temperatures Te = 0.6815, 0.67, 0.66, 0.6513, and their equilibrium energy Se are marked by horizontal black 
dotted lines. The highest bottom of these states marks a lower bound on the best possible limiting energy for a slow annealing. 
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Fig. [5] presents the same data as Fig.|4]in a difFcrent perspective. It is a sort of direct look at the shape of states in 
the energy landscape. The y-axis is still the energy, the x-axis depicts the size (entropy) of the state. More precisely 
we plot a line at —S/2 and S/2. The blue (most outer) line is the entropy of the equilibrium (static) solution. The 
four red lines correspond to different Gibbs states. The horizontal dashed lines depict energy at which these states are 
the equilibrium Gibbs states. Note that according to the laws of thermodynamics the derivative of the energy at the 
minima have to be zero, whereas figure [5] shows a slight non-physical cusp. This is dues to the IRSB approximation 
that underestimates the entropy, the FRSB solution would have the correct derivative. 

E. Below the Kauzmann transition: Level crossings and temperature chaos 




Temperature Temperature 

FIG. 6: (color online): Explicit demonstration of the presence of temperature chaos below the Kauzmann temperature in the 
fully connected 3-spin model. Left: the energy as a function of temperature for states below the Kauzmann transition: the four 
curves correspond to temperatures Te — 0.4, 0.5, 0.6 and 0.6513. Right: The crossing of free energies of different states at a 
function of temperature. The lower envelope (blue) is the equilibrium free energy: it results from the crossings of many states; 
here we show three such states that are the equilibrium ones at temperatures Te — 0.4, 0.55, 0.65. Inset: to make the crossing 
more evident, we plot the difference SF between the free energy of these three different states and the equilibrium free energy. 

We now turn to the description of static spin glass phase, T < Tk- Fig. [5] uses equations derived in Sec. IIVCI 
and depicts the evolution of states that are at equilibrium below Tk- Fig. [6] left gives the energy as a function of 
temperature for three states that are at equilibrium (marked by red points) at some temperature Te < Tk- In Fig. [5] 
right, we plot the free energy as a function of temperature of these states, the lower envelope of the free energies of 
all the states is then the equilibrium free energy. In order to enhance the differences, in the inset, we subtracted the 
equilibrium free energy from the free energies of the three states. 

These plots clearly show that, although a finite number of states dominates the partition sum (which is the very 
definition of the glass phase below Tr-), these states become out-of equilibrium as soon as the temperature is slightly 
changed. Even though for all < Tk the partition sum is dominated by a finite number of state: these states change 
entirely when the temperature is slightly modified- This is the phenomenon of temperature chaos that appears due to 
free energy levels crossing. 

Temperature chaos has been discussed extensively in spin glasses, sec for instance^^— , it is crucial in the interpre- 
tation of memory and rejuvenation experiments^!^. It existence was subject of debates, as its absence was advocated 
in many papersi2r2^, as well as its presence^^"— . Our results allow to finally clearly demonstrate that temperature 
chaos is present in the Ising fully-connected p-spins, and that it arises through many level crossings, as advocated 



F. The phase diagram of evolving states and the mapping to a ferromagnetic p-spin model 

As we derived in Sees. Ill Fl and IIVBI all the physics of the adiabatic evolution of equilibrium states above the 
Kauzmann temperature for the Jq = p-spin model can be induced from the known, see e.g i^^'^"^ , phase diagram of 
the Jo 7^ p-spin model. We will now discuss the phase diagram in the context of results given in Figs. H] and [S] 
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FIG. 7: (color online): The phase diagram of the fully connected 3-spin model with a ferromagnetic bias (left), or equivalently, 
the phase diagram in function of the two temperatures Ta and Te in the state following formalism. True phase transition are 
marked by thick lines, while spinodals and the Nishimori line are draw thin and dashed. The two phase diagrams are given 
to highlight how the physics of states following can be understood intuitively from the ferromagnetically biased model. Note 
that the line denoting the transition from spin glass to ferromagnet (computed at the IRSB level) is almost but not completely 
straight. 



Fig. [7] shows two drawings of the phase diagram, the y-axes in both is tlie actual temperature. The x-axes on the left 
is the standard ferromagnetic bias Jo = /3e on the right the x-axes is the equilibrium temperature Tg = J^/ (2 Jg) 
(in both figures we took J — \). The red (dashed) line in both parts is Ta = ~ J^/(2Jo), on the left this is the 
Nishimori line, on the right this is the equilibrium line. The task is to follow states that are the equilibrium ones 
on this line for > Tk- The horizontal black lines depict the location of the dynamical, Kauzmann and Gardner 
temperatures for Ta- 

The phase diagram of the p-spin model with a ferromagnetic bias Jq, Fig. [7] left hand side, see also^iS has five 
thermodynamic phases separated by thick lines in the figure: The paramagnetic phase at high temperature (PARA). 
The IRSB spin glass phase for low enough bias Jq and T < Tk that becomes a full RSB phase for T < Tq- The 
ferromagnetic phase (FERRO) for Jq large enough and T < Tp that becomes a mixed phase with both ferromagnetic 
and full RSB order (MIXED) for T < TpusBmixed- At low enough Jq the system is a spin glass with an crgodicity 
breaking transition at Td and then the Kauzmann and Gardner phase transitions at Tk and Tq. At larger Jq, the 
system undergoes a first-order ferromagnetic transition at Tp. The ferromagnetic state is thermodynamically stable 
starting from the spinodal temperature Tg > Tp, at Tp it becomes thermodynamically dominant. Below the pink line, 
TpRSB mixed, the replica symmetric solution describing the ferromagnetic state ceases to be stable toward RSB and the 
system transits into the FRSB mixed phase. The mixed phase have some unphysical spinodals: below the light-blue 
line there is no non-trivial ferromagnetic RS solution. This is cured by the IRSB approach, but only down to the 
green line, below which there is no non-trivial ferromagnetic IRSB solution. The correct spinodal should be a vertical 
line in the FRSB computation. The Nishimori line is the red dashed curve: notice how it crosses the ferromagnetic 
transition exactly when Tp ~ Tk and the spinodal at Tg = Td- 

The right hand side of Fig. [7] depicts the same diagram as a function of the equilibrium temperature Tg. Following 
a state at equilibrium at temperature Tg to temperature Ta is equivalent to looking to the ferromagnetic state on 
the Nishimori line at Tg, and then to move vertically to other temperatures Ta- The vertical strip of temperatures 
Tk ^ Tf, < Td is hence particularly relevant for state following. The blue spinodal ferromagnetic line Tg thus 
corresponds to the high temperature spinodal line in state following (see Fig. |4]). The pink line Tfrsb mixed to the 
point where the state divides into many sub-states and develops a (presumably) full replica symmetry breaking. 
However, we are unable to follow the state with the RS formalism below the light blue line that correspond to an 
unphysical spinodal. This is cured in part by the IRSB formalism, but the same problems arises in this case below 
the green line, so that a FRSB solution is eventually needed to describe the adiabatic evolution of states at Tg = Td- 

For Tg < Tk {Jo > J'^/ {'^Tk)) the phase diagram shows a ferromagnetic phase which would correspond to following 
a state that almost surely does not exist for a typical instance of the problem. To follow states equilibrium below Tk 
the mapping to a model with a ferromagnetic bias breaks. 

Two comments are in order about the spinodal and the ferromagnetic transition. Let us first discuss the spinodal, 
which we believe to be vertical bellow Td'. the FRSB ferromagnetic solution in the mixed phase must exist up to 
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the vertical blue line. However, different levels of replica symmetry breaking have different unphysical spinodal lines 
beyond which no-nontrivial ferromagnetic solution exist at the RSB level (the blue spinodal for RS and green for 
IRSB are depicted). Such behavior is not unheard of: the very same phenomena takes place in the study of the 
Sherrington Kirkpatrick model in external magnetic field^ (that is, for p = 2). There also the boundary of the mixed 
is a vertical line in the FRSB solution, but differs at all finite levels of RSB^^iSi. Similar features were observed in the 
dilute mean field spin glasses as well^i^. In the state following method the lack of a ferromagnetic solution near to 
the true FRSB spinodal translates into difficulty of obtaining a sensible IRSB upper bound on the low temperature 
adiabatic evolution of states with Tg ~ Td- 

Let us now consider the ferromagnetic transition line Tp bellow the Nishimori line. Nishimori proved^ that the 
line was either vertical, or bending towards the ferromagnetic phase, this is also apparent from the states-following 
interpretation. Although it might not be completely visible from Fig. [7] (left), the analysis of the IRSB equations 
shows that the line is bending slightly towards lager Jq as T is lowered, although the effect is very small (to the best 
of our knowledge, this was an unknown feature of this phase diagram). Interestingly, this has a clear interpretation in 
the states-following formalism. At zero temperature, the energy of the ferromagnetic state at Jo = 1/(2?^) is equal 
to the bottom energy of the equilibrium state at Tk- As discussed in Sec. IIV El chaos and level crossings make these 
states to have a larger energy than the true equilibrium one at T < Tk', as a consequence, the ferromagnetic state 
at T = and Jq — 1/{2Tk) must have bottom-energy larger than the ground state energy of the system, so that the 
ferromagnetic transition can only happen for larger values of Jq. Interestingly chaos disappears in the large p limit 
(as well as in the spherical approximation) and this is why this line is strictly straight in the phase diagram of the 
random energy model^, and in the spherical p-spin model^^^S^. 



G. Relation to the Franz-Parisi potential 



The idea of exploring one of the many phases in glassy mean field systems is a very natural one, and is therefore 
not new. Our states following approach is actually related to the one pioneered by Franz and Parisi years ago '^'^^i^^'^^ , 
which is now commonly referred to as the Franz-Parisi potential. Their idea was to study glassy systems in presence 
of an attractive coupling among two real replicas, one of which being at equilibrium. Looking to the free energy of 
the copy when its overlap with an equilibrium configuration is tuned allows to compute the local free energy potential 
around this equilibrium point. 

What the states following method is actually doing is to focus directly on the minimum of the Parisi- Franz potential, 
thus bypassing the need of an attractive couplings and making the formalism much simpler and applicable easily to 
the models on sparse graphs. The Franz-Parisi potential can, however, be obtained within the states following method 
if we fix the overlap between the state at temperature Tg and Ta . The purpose of the present paragraph is to explain 
how to do this in the p-spin model. The reason is two-folds: (a) we want to make the correspondence with the 
Franz-Parisi formalism and (b) looking at these free energies turns out to be extremely instructive to understand the 
unphysical spinodal points and related issues discussed in the previous section. 

Conveniently enough, in our mapping to a model with an effective ferromagnetic coupling Jq, the "magnetization" 
parameter m (|40p is nothing else than the overlap of the configuration under study and the planted one. This 
demonstrates the usefulness of the above mapping: The free energy at fixed magnetization of a p-spin model with 
a ferromagnetic bias Jo a-t the temperature T is equal to the Franz-Parisi potential for the spin glass problem with 
temperature Tg = JV(2Jo) and Ta = T. 

Fixing the magnetization, i.e. ensuring Si/N = m, is done by introducing a Lagrange multiplier h and writing 
the partition function of the system with a fixed magnetization as Z,„ = Z/jC"^^'*™, where Z/^ is a partition function 
of the model with an external magnetic field, i.e., with Hamiltonian = iJ — ^i- Once we compute the free 
energy of the model with external magnetic field f{h) the free energy of the system with magnetization fixed to m is 
recovered via /(m) = /(h) + hm. To fix a value m = m* we need to ensure that df{h)/dh\h* ~ — m*; the f{m) is 
thus a Legendre transform of f{h). 

This allows us to derive easily the Franz-Parisi potential in the p-spin model. Actually, it also allows to obtain 
instantaneously all the (not straightforward) Franz-Parisi computations in the spherical and mixed spherical p-spin 
models just by looking to the equilibrium free energy of the model with a ferromagnetic bias. The reader is invited 
for instance to compare the free energy in^^ with the Franz-Parisi potential in^i^. 
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1. Franz-Parisi potential at the replica symmetric level 
At the RS level, the equations for the p-spin model with an external field h become: 

m = f Vytanh ( PaJy^pq^^ + PaJapmP-^ +I3ah\, (65) 

J — OO 

I Vyi&nh^UaJyVMP^ + MoPmP^^+Pah), (66) 

with Vy = dy /\'27r. The free energy is given by with f3ah added in the argument of the cosh . 

Note that when the free energy is non-convex (as it is in the present case), one has to be extremely careful in solving 
these equations. Indeed if one simply chooses h once and for all and simply performs a recursion of Eqs. (|65ll66p some 
values of m will never be obtained. A good method is to first choose the desired value m* , and then to fix the magnetic 
field h at each iteration such that Eq. (j65|) is satisfied. This can be easily generalized in the IRSB equation. In Fig. [51 
we show the results of this procedure. 
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FIG. 8: (color online) The replica symmetric free energy of a state at temperature Ta given the distance m from an equilibrium 
configuration at Te in the 3— spin fully connected model. The points indicate the minima corresponding to what the state 
following method finds. Left: In this case Ta = Te; a minimum starts to form around the equilibrium configuration for 
< Td = 0.6815 while in the liquid phase Te > Td no such minimum exist. Right: We now use Ta 7^ Te (here Te — 0.67) 
and we observe how the curves are evolving with Ta. Upon warming, the minimum happens at lower free energies and m is 
decaying, indicating that the state gets larger until finally a spinodal point is reached and no more minimum exist; this is the 
moment where the state melts into the liquid. Upon cooling, we thus expect that both the free energy and m increase. This 
is indeed the case, but for low temperature (here Ta = 0.46) we start to observe a non monotonous behavior for m. Worse, if 
the temperature is again lowered (here Ta = 0.4) the minimum disappears. These are non-physical features and are clear signs 
that replica symmetry must be broken for low temperatures. 

The left side of Fig. |S] shows the free energy of configuration at a distance m from the planted one in the ferromag- 
netically biased model; this is the Franz-Parisi potential. One sees that for > Td = 0.6815 there is no minimum 
except the trivial one at m = 0; for < Td = 0.6815, however, a second minimum appears, with a finite value of the 
overlap: this is precisely the one found in the states following approach, which is only performing a gradient descent 
in this free energy starting from the point m = 1, thus directly focusing on the non trivial- minima of the free energy 
potential. 

The right hand side of Fig. [8] shows the free energy potential of configuration at a distance m from the planted one 
when the temperature is different from the planted temperature. We have used Te = 0.67 and we can see how the 
free energy of the state changes with temperature. This is actually very instructive. When rising the temperature 
the bottom free energy of the state decreases (as a free energy should with temperature because of the positivity of 
entropy) while the overlap m at the minimum get smaller: this is the sign that the state become larger. At even 
larger temperature, a spinodal point is met and the minimum (as well as the state) stop to exist. 

When decreasing the temperature, we expect that both the free energy and m increase, as the state gets smaller 
and deeper in the free energy landscape. This is indeed the case initially, but for low temperature (here Ta — 0.46) 
we start to observe a non-monotonous behavior for m. If the temperature is further lowered (here Ta = 0.4) the 
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minimum disappears, as we have seen in the previous chapter. These are non-physical features that show that the 
rephca symmetric assumption is incorrect and that we need to break the rephca symmetry. 



2. Franz-Parisi potential at the replica symmetry broken level 



-0.75 
-0.76 
-0.77 
-0.78 
-0.79 
-0.8 
-0.81 
-0.82 



RS - 






1RSB - 








Te=0.67 Ta=0.4 






Full RSB zone 


RS zone 









0.5 



0.6 



0.7 0.8 
m 



0.9 




FIG. 9: (color online) Left: Comparison between the RS Franz-Parisi potential lower curve (red) and the IRSB one upper curve 
(blue). The point marks the minima on the IRSB curve. Right: Magnetization of the minima as a function of temperature Ta- 
Again the lower (red) curve is the RS result, the upper (blue) curve is the IRSB result. The increasing or non-existing part of 
the curve in unphysical, the size of the unphysical region is much smaller in the IRSB result. 

To obtain the IRSB approximation of the Franz-Parisi potential we need to fix the parameter m in the IRSB 
equations using again an auxiliary magnetic field h. The result for Ta = 0.4 and ~ 0.67 is shown in Fig. IHllcft. 
The lower line (red) is the replica symmetric result, the upper line (blue) is the IRSB result. The two curves differ 
in the RS unstable zone on the left side of the plot. Unlike the unstable RS result, the IRSB Franz-Parisi potential 
has a secondary physical minimum at about m ~ 0.776. Moreover, as general in replica theory, the IRSB free energy 
is always larger than the RS one. 

Right part of Fig. [S] shows the dependence of the magnetization at the minimum as a function of temperature T^. 
Following states becomes studying ferromagnetically biased model, in ferromagnets magnetization usually grows as 
the temperature decreases. Hence, the part where m{Ta) increases (or does not exist) is unphysical and will decrease 
in the FRSB solution. We can see that the physical region extends into lower temperatures Ta for the IRSB result. 
We also observed that the IRSB magnetization is systematically larger than the RS one. 

The above findings suggest a method how to obtain a lower bound on the energy of the state even at temperatures 
where the IRSB solution does not exist (the IRSB Franz-Parisi potential docs not develop the secondary minima). 
At such temperature Ta the magnetization at the real minima (which we would observe in the FRSB result) have to 
be larger than the maxima of magnetization mm in the IRSB result over all Ta- As the FRSB free energy is larger 
that the IRSB one the free energy at that minima have to be larger than the IRSB free energy at mm- Using this 
receipt we can thus obtain a lower bound on the free energy (and energy) which is probably not far from the true 
result. This is how we obtained the green dotted part in Fig. 

Note, however, that the above described construction of the lower bound is not very elegant and requires the 
calculation of the full Franz-Parisi potential f{m). It is interesting to see if better approximation to the FRSB result 
can be obtained using different techniques. 



V. SECOND APPLICATION: ENERGY LANDSCAPE IN CONSTRAINT SATISFACTION PROBLEMS 

AND DILUTED MODELS 

We have discussed at length the various aspects of adiabatic evolution of Gibbs states for the simple case of fully 
connected p-spin model because many of those aspects repeat for the computationally more involved models on sparse 
random graph like XOR-SAT or graph coloring. In this section we present results for those two models. 
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A. Following states in diluted spin models 




FIG. 10: (color online) Representative behavior of states in diluted mean field systems. Left: The XOR-SAT problem with 
K — 3, L — 3. Right: the XOR-SAT problem with K = 3, L = 4. The value of energy here is the number of violated constraints 
per variable. The blue line crossing the diagram is the equilibrium energy computed from the standard cavity method, Eqs. (|16l - 
I21|) . The vertical lines denote the dynamical and Kauzmann temperatures. The red lines depict adiabatic evolution of states 
that are the equilibrium one at the temperature Te where the red curve crosses the blue one. The state evolution curves are 
obtained by solving equations (|24I26[) when Te > Tk, and Eqs. (|32l37p when Te < Tk (in the inset of the right hand side). The 
dashed part of the red curves depicts the region of temperatures where the state is no longer stable towards replica symmetry 
breaking and splits into many sub-states. The ends of the red curves at nonzero temperature correspond to the non-physical 
spinodal points beyond which Eqs. (|24l26p have only the trivial liquid solution. 



In Fig. [TU] we plot the energy of states versus temperature for the 3-XOR-SAT problem with degree of variables 
L = 3 (left), L = A (right). The behavior is extremely similar to the one of the fully connected model and the 
very same feature are observed: the spinodal upon heating, the transition towards symmetry breaking upon cooling, 
and the unphysical spinodal. Note that these plots have been obtain with the RS procedure and a first remark is 
that the RS computation gives a more complete results than in the fully-connected case. Since equilibrium states 
do not develop the Gardner instability, it is not surprising that the instability towards RSB is less strong in the 
out-of-equilibrium states as well. However, we observed once again that the states at equilibrium close to Td undergo 
a FRSB transition and decompose into many marginally stable sub-states: this seems to be an universal features of 
spin-glasses. 

In order to check these results, we have performed the following numerical simulation. We have first prepared two 
large XOR-SAT system with c = 3 and K = 3 and N = 200000 spins at equilibrium for temperature T = 0.22 and 
T = 0.25. Of course, since these temperatures are below the dynamic transition, this would be an impossible task 
if wc could not use the planting trick described in Sec. Ill El that allows to prepare at virtually no computational 
cost a random instance together with an equilibrated configuration. Then, we have used a metropolis Montc-Carlo 
algorithm initialized in the planted configuration to follow the state upon slow cooling and slow heating. As shown 
in Fig. [TTl the results of the simulation agree perfectly with the theoretical predictions, including the location of the 
high temperature spinodals. 

As already pointed out computing the limiting energy of adiabatic simulated annealing corresponds to the zero 
temperature Tq = energy of a typical state with — Td, and this requires to consider replica symmetry breaking 
within the states. At least the IRSB computation plus the analysis suggested in Sec. lIV (T2] is needed to compute lower 
bounds on the energy achieved by the infinitely slow annealing. This is numerically involved and we will thus address 
it in subsequent works. Another way of accessing this energy-value would be to solve the dynamical equation a^'^i^^" — , 
which at current time seems to be even much harder task. Despite these limitations, a very useful new insight about 
the energy landscape and limitations of simulated annealing and other stochastic local search algorithms can be 
obtained from the results that we already have from the states following method, as we explain in the next section. 
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FIG. 11: (color online) Following states in the XORSAT problem with c = 3 and K — 3 with Monte-Carlo simulations. On 
this picture, we have reproduced the data of Fig. [10] with Monte-Carlo simulation (black and green crosses). We have prepared 
a large XORSAT system at equilibrium for T — 0.25 and T — 0.22 and performed slow cooling and heatings with a Monte- 
Carlo procedure: when the dynamics is slow enough (we have changed the temperature only by a factor AT = 10~* at each 
Monte-Carlo steps) the energy in the simulation follows perfectly the prediction of the states following formalism. We have 
thus succeed in predicting the adiabatic evolution of the dynamics starting from equilibrium. 
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FIG. 12: (color online): State following for the 4-coloring of 9-regular random graphs. Equilibrium in blue, several states in 
red. Unlike in the XOR-SAT problem, here the states descent very fast to zero energies. 

B. Canyon versus valleys 

Let us turn our attention to Fig. [12] It depicts in the same manner as before the evolution of states for the 4-coloring 
of 9-regular random graphs. Unlike in the examples in Fig. [TU]we see that all depicted states fall very fast down to 
zero energy. Again due to RSB instabilities, so far, we are not able to show explicitly that the state with = Tj, goes 
down to zero energy. But in any case we see that the asymptotic behavior at zero temperature is rather different. 

In order to be precise, we now distinguish between two types of states: 

• Canyons are states with bottoms at the ground state energy. 

• Valleys are states with bottoms strictly above the ground state energy. 

By definition there is at least on canyon-state in every system. The definition is rather intuitive when looking to the 
carton of the energy landscape in Fig. [T] The difference between canyons and valleys is accentuated in Fig. [15] where 
data from Figs. 1101 and [T^ are plotted in order to visualize the shape of the states. The energy is plotted against the 
entropy s — /3a(e — /) for different equilibrium states. We plotted s(e)/2 and — s(e)/2 such that the width corresponds 
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to the logarithm of the number of configurations at energy e for the Gibbs state. The left hand size is for the L = 3 
3-XOR-SAT, right hand side for 4-coloring of 9-regular random graphs. The blue (the most outer) curve corresponds 
to the equilibrium energy and entropy. The different red curves are shapes of states equilibrium at energy Ce depicted 
by the horizontal black dashed lines. The bottoms of depicted states on the left are at positive energy hence these 
states are valleys, whereas the bottom of the state depicted on the right is at zero energy, this is hence a canyon. 




FIG. 13: (color online): Data from Fig. [10] and [12] plotted in order to visualize the energy landscape. The energy e is plotted 
against the entropy a = I3{e — f) for different equilibrium states. We plotted s(e)/2 and — s(e)/2 such that the width corresponds 
to the logarithm of the number of configurations at energy e for the Gibbs state. Left: XOR-SAT with c = 3, K — 3. Right: 
4-coloring of random graphs with c = 9. The black curve corresponds to the equilibrium total entropy. The red curves are 
different equilibrium states, corresponding to Te — 0.15, 0.2, 0.24 (left), and Te = 0.12 on (right), the energies corresponding to 
Te are depicted by horizontal black dashed lines. The left side states, with their finite energy bottoms, remind us of the valley 
in Fig. [T] while the right side reminds of deep canyons that all reach the ground state energy level. Note that our distinction 
between canyons and valleys is purely energetic, both canyons and valleys can have both zero or positive bottom entropy. 

Based on the distinction between canyon-states and valley-states, we now describe two distinct types of energy 
landscape, depending on the basin of attraction of states at the dynamical transition = T^: 

• In the canyons-dominated landscape, a typical equilibrium state at = is a canyon. 

• In the valleys-dominated landscape those states are valleys. 

In the previous examples, the cases of the XORSAT problem we showed have valleys dominated landscape and the 
coloring example is canyons dominated. This has a deep algorithmic consequence: an adiabatically slow simulated 
annealing is able to find the ground state in the canyons-dominated landscape, but this is not the case for the valleys- 
dominated landscape. In constraint satisfaction problems where one can change continuously the connectivity, we 
thus expect that there will be a sharp transition Ccv from the canyons-dominated landscape to the valleys-dominated 
landscape as the density of constraints is increased. This phase transition must happen between the clustering and 
satisfiability threshold, Cd < Ccv < Cg- We will now argue that the canyons/valleys transition Ccv is upper bounded by 
the rigidity transition introduced i n^^i^^ . 

C. The warning propagation limit and the bottoms of states 

It is possible to derive analytical equations for the energy of the bottoms of equilibrium states, i.e. in the zero 
temperature limit, (3a — > oo. This is simply the limit of Eq. ([M)) that takes a simpler closed form when Ta = 0. Here 
we present these equations and their derivation for the XOR-SAT problem. We also derived corresponding equations 
for the graph coloring. 

We consider for simplicity that degree of every variable in the XOR-SAT problem is fixed to L and all interactions 
are antiferromagnetic Jo = —1. For our purpose it is convenient to rewrite Eq. (|24p in terms of probability e that a 
constraint is violated in the planted configuration, Eq. (|15p . 
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where the sums in the Kronecker deltas are modulo 2, and is defined by the BP equation ^ at zero 

temperature /S^ — >■ oo. In this limit we can write the warning propagation version of Eq. (j67p which can be solved 
without the use of population dynamics. 
Let us introduce the following probabilities 

• /i is a probability that a given constraint is forcing variable into a value in which it was planted (warning from 
a to i) 

• 77 is a probability that a given constraint is forcing variable into a value in which it was not planted (warning 
from a to i) 

• /2 is a probability that a variable is being forced into a value into which it was planted (warning from i to a) 

• ?7 is a probability that a variable is being forced into a value into which it was not planted (warning from i to a) 
The following equations are then linking the above probabilities 

A = E E ' „ ^ ^ ^^^^'^^(i - ^' 2^) , (68) 

■^-^ ^-^ s r + s LL — 1 — r — 2s) 

Z.-2 ^ 

« - 1 1 )g:!''.-2,)i - " - ■ («^' 

and 

K-\ K-1 

^ (^'^\^„ (2r)!(j^-l-2r)! ^ + ^ A. (2r + 1)!(A- - 2 - 2r)! ^ " ' ^^^^ 

„ fl - e) V ^^^-^)^- ~if-2-2r^2r+l , - ^)^- ~K-l-2r ~2r 

(2r+l)!(i^-2-2r)!^ ^ ^ ^ (2r)!(i^ - 1 - 2r)! ^ ^ ' 

Sanity check is that the above equations give /i = (1 — (1 — /i)^^^)^^^ and 77 = when e = 0, this is the equation for 
appearance of the hard fields derived in^. 
The corresponding energy is expressed as 

L/2 

^ = E rP^+Q^(T) - L{1 - l/K)Pa , (72) 

where Pi^Qi(r) is the probability that r contradictions happened when a variable i and all its neighbors are added. 
And Pa is the probability that a contradiction happened when the constraint a was added. We have 

K-l K_ 

- - t i2r + mK- 1 - 2ry. + ^ g (2.)!(f - 2.)! ^""^^^^^ ' ^^^^ 

= g H(. + .)!(L-,s-2.)! - - + 

E' ^T^TW ^ ^''''''^^(1 - ^ - ^)^"-^-'^^ + , J- , „ M^'f (1 - M - . (74) 

r!(r + s)!(L — s — 2r)! r!r!(/7 — 2r)! 

The solution of these equations is depicted in Fig. [14] by a black line. Because of the relaxation within the state, 
the bottom is significantly lower than the equilibrium energy (red line). 

Let us compare the state following result with an interesting heuristic idea to estimates the bottoms of states that 
was developed in^ (see also^). It uses an approach called iso-complexity. Instead of exactly following the states, the 
authors proposed instead to count the number of states at a given temperature Te, and then to consider the energies 
at T < Te for which the number of state is equal to the one at Tg. Iso-complexity leads, however, only to a lower 
bound, because ending up at lower energies would be exponentially unprobable. We see in Fig. [TJ] that indeed the 
true bottom is always at larger energy than given by the iso-complexity computation oS. 
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FIG. 14: (color online) Comparison between the exact adiabatic evolution of states and the iso-complexity lower bound. The 
black line is the energy of the bottoms of states that were the equilibrium ones at temperature Tk < Te < Td in XOR-SAT for 
c = 3, p = 3 (left, the inset is a zoom) and for c = 4, p = 3 (right). The red (upper-most) line is the equilibrium energy at Te. 
The blue line is the iso-complexity lower bound from^. 



Note also that above certain temperature Te the equations do not have any non-trivial solution, this corresponds 
again to the to the non-physical spinodal point is observed in Fig. [101 The physical reason for this is that the states 
are unstable against RSB and that wc should have used the RSB formalism. The noise level e corresponding to this 
spinodal point is summarized in Table HI 
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0.01665(1) 
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0.571804 


3 
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0.05184(1) 


0.094346 
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0.09558(1) 
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0.723037 
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0.00656(1) 
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0.03179(1) 
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0.933018 
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0.06673(1) 


0.087771 


0.794195 


4 


6 


0.08815(1) 


0.123228 


0.857183 


5 


3 


0.00349(1) 


0.006069 


0.936580 


5 


4 


0.02298(1) 


0.043819 


0.952231 


5 


5 


0.05259(1) 


0.068310 


0.830129 



TABLE I: Largest values of e with a non trivial solution of Eqs. (|68I71[I in the XOR-SAT problem. This gives a lower bounds 
to the largest possible values of the noise in the noisy reconstruction on trees. 



D. Where the really hard problem really are? 

We shall now argue that the canyons/ valleys transition Ccv is upper bounded by the rigidity transitional^. In the 
limit Te — >■ (e — >■ 0), the equations for the bottom-energy of the states (|68II71|) reduce to the equations for frozen 
variables in the equilibrium zero temperature states fro m^^i^^ . 

In the same limit the bottom of a low Te state ((72)) is positive if there are frozen variables in the ground state 
Te = 0. Also in order to have a non-trivial (i.e. E > 0) solution at finite Te, we need a non-trivial solution at Te = 0: 
hence if there arc no frozen variables in the ground state then Eqs. (|68ll7ip have only the trivial paramagnetic solution 
for low Te which means that cither the bottoms of low Tg states are at zero energy or that we encountered again the 
previously discussed instability that prevents us to follow some states down to zero temperature using only the replica 
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symmetric approach. 

On the other hand, when there are frozen variables in the equihbrium state at zero temperature the landscape is 
always valleys-dominated and simulated annealing (and presumably any simple algorithm with local moves) will not 
be able to find the ground state: these corresponds to truly difficult problems. 

The instability towards RSB unfortunately prevents us from showing explicitly that the canyons-valleys transition 
is strictly larger than the dynamical transition (in the model such as K-SAT or graph coloring where the later does 
not coincide with the rigidity transition). However, it is reasonable to expect this is the case and indeed the behavior 
of simulated annealing observed in simulation confirms this^. The existence of a phase with canyon-dominated 
landscape thus explains the unreasonable efficiency of some stochastic local search algorithm o^'^i^" . The really hard 
problem requires the landscape not only to be glassy but also not to have states going down to zero energy with a 
large basins of attraction, i.e. to have a valleys dominated energy landscape. 

Our analysis also provides an insight about the types of solutions that are achieved by simulated annealing or 
stochastic local search. Those solutions are clearly not equilibrium ones and instead belong to the bottoms of states 
that undergo full-step replica symmetry breaking at low temperatures. The existence of the above discussed spinodal 
line means that there is no low temperature belief propagation fixed point associated to these states. This was indeed 
observed numerically in previous works^i^iiS^ - when BP is initialized in a solution found by some heuristic algorithm 
it always converges back to the replica symmetric fixed point. The procedure called whitening^i^^^— never finds a 
non-trivial fixed point either when initialized in solutions found by survey propagation or other heuristics. 

Our results explicitly explain why solutions found by polynomial heuristics have quite different properties from the 
equilibrium solutions that are usually described by the cavity method. This shows how futile are the attempts to 
study clustering, BP fixed points, and other equilibrium predictions starting from solutions obtained by heuristics 
solvers! Instead exhaustive search, planting techniques or other provably equilibrium procedures have to be used if 
one wants to consider equilibrium configurations. 




time 

FIG. 15: (color online) Iteration of Belief Propagation in the 4-coIoring problem of graph with average Poissonian degree 
c — 8.4. The average magnetization of BP messages is plotted versus the number of iterations. When initialized in the 
equilibrium solution (obtained by planting), BP converge to the non trivial magnetization, in agreement with cavity prediction. 
On the very same graph, when initialized in a solution obtain by Walk-COL, it however converges to the trivial fixed point. 
This shows solutions found by heuristic solver are very different from the equilibrium ones, and instead belong to clusters that 
do not have an associated BP fixed point, as expected from the picture obtained by the following state method. 

In order to illustrate this we created an instance of the coloring problem using the quiet planting procedure and 
ran belief propagation initialized both in the planted configuration, and then in a solution found by the Walk-Col 
algorithm introduced ir4i. Fig. [T51 shows how the magnetization evolves with number of iterations. BP initialized in 
the planted configuration converges to a non-trivial fixed point at a value of magnetization that describe the "width" 
of the corresponding equilibrium states, which is perfectly in agreement with the cavity prediction^. However, BP 
initialized in the Walk-Col solution converges to a trivial fixed point after an intermediate plateau corresponding to 
flattening of the underlying potential. The potential does however not have a minimum hence BP ends up in the 
trivial fixed pointiSi. This plateau corresponds to the deep minima found is experiments with whitening procedure, 
when a number of changes is plotted as a function of the number of interactions^^i^l. The same behavior is observed 
in the entropy at a certain distance from a solution investigated i n^^i^^ , which is the Franz-Parisi potential at zero 
temperature. 
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This show unambiguously that many types of solutions exist in these problems, and that one should not confuse 
the equilibrium thermodynamic solutions of the standard cavity approach, with the out- of- equilibrium solutions, that 
should be studied with the formalism we have introduced here. 

VI. CONCLUSIONS AND DISCUSSION 

We have described how to follow adiabatically Gibbs states in glassy mean field models, answered some long- 
standing questions about the glassy energy landscape, and we have computed for a first time the residual energy 
after an adiabatically slow annealing from equilibrium. We have described the behavior of out-of-cquilibrium states, 
and demonstrated the presence of temperature chaos in these mean-field models. We have found new features of the 
energy landscape, and identified a new transition from a canyons-dominated landscape to a valleys-dominated one that 
allows to quantitatively understand why ground state configurations are sometimes easy to find despite the presence 
of a glass transition. We have also shown that these out-of-equilibrium ground-states have different properties than 
the equilibrium ones, thus explaining many apparent discrepancies between theory and simulations in the literature. 
Finally, we have also checked some of these results using Monte-Carlo simulations. 

On the methodological side of our work, the states following method we have developed has interesting connections 
to the reconstruction on trees and it is also closely related to the Franz-Parisi potential. In some models it can be 
re-interpreted via the planting of an equilibrium configuration, which is in particular useful for speeding up simulations 
and we shall pursue on this aspect in forecoming works. A curious and interesting connection between the properties 
of the glassy systems and ferromagnets on the Nishimori line is found and its consequences for the physics of the glass 
transition will be also explored in subsequent works. 

The method of states following has, however, one drawback that arises due to the instability of states towards 
full-step replica symmetry breaking at lower temperatures. Usually in such a situation replica symmetric or IRSB 
approach can be used as a sensible and very accurate approximation. However, we found oursclf here in the rather 
particular situation where there is no non-paramagnetic RS or IRSB solution for states with Tg close to at low 
Ta (as illustrated in Fig. 2]), in a region where we anticipate FRSB to be the correct solution. Since it is not known 
how to obtain the FRSB solution in the diluted systems, this prevents us from computing concrete values of limiting 
energies for adiabatic simulated annealing initialized at high temperatures. Clearly this calls for new investigations 
and for new ways to approximate the FRSB solution. We have suggested one such approximation that gives a sensible 
solution even in this region in Sec. IIV G 21 but it is still a computationally costly one. A simpler approach thus 
need to be developed. Maybe the direction suggested i n^^i^^ , with marginal states (and supersymmctry broken cavity 
method) and the use of the so-called two groups ansatz could be a way out of this problem. Note also that the " gap" 
in the S(s) (how many states of a given size are present) in the coloring problem reported in^ might be related to 
the instability observed in the present paper. 

The formalism of adiabatic evolution of states in temperature should extend straightforwardly when other external 
parameters are changed adiabatically. It would be interesting to sec if one can take as the adiabatic external parameter 
the density of constraints (or average degree of the graph) one study the " connectivity" landscape introduced i n^^ios ^ 
Our work offers extensions in many other directions as detailed description of the complex energy landscape is 
immensely useful in understanding properties of complex glassy materials. Among possible applications are the studies 
of memory and rejuvenation protocolaiSS, of jammed packingsi^ and of the quantum adiabatic algorithroi2Li22. 
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Appendix A: The large connectivity limit of the cavity equations 

The solution of the fully connected p-spin model was originally derived from the replica tric k^^i'^^" — . The cavity 
approach was developed later on as an alternative to the replica trick, and the p = 2 solution recovered in this way^. 
In this appendix, we remind how this computation generalizes and how the large connectivity limit of the cavity 
equations yields the RS and IRSB solutions of the fully connected p-spin model. This should facilitate understanding 
of our derivation of the equations for states following in the main text. 
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1. The replica symmetric solution 

To achieve our goal, it is first suitable to rewrite Eq. (|4]) in terms of cavity fields /i'^" and biases u''"*' defined as 

" 2cosli/3/i*^'^ ' ^^^^ 
^'r- = TT^-T-rr-i, (A2) 



it gives 

h'^"" = J2 ' (A3) 

tanh(/3u''-'') = tanh(/3Jf,) J| tanh (/S/i^'^'') . (A4) 

At this point, the recursion can thus be written in terms of the local fields /i*^" as 



f^i^a = i arctanh 



bGdi\a 



tanh(/3J6) Yl tanh(/3/tJ'^'') 

jedb\i 



(A5) 



In the fully connected p-spin problem every spin is involved in ^ N'^ ^ /{p— 1)! interactions, and each of these 

interactions Jh is small, of 0(iV^~P). Eq. (jA5[) can thus be rewritten introducing a new message m*"*" ~ tanh (/3/i*^'^) 



m 



= tanh I /3 E n I ^ ^1^" - ^o"'" ■ 

b(Edi\a jf^db\i 



At this point one realizes that the argument of the tanh is a sum of many terms. In the replica symmetric ap- 
proximation these terms are considered independent and thus according to the central limit theorem the sum is 
distributed as a Gaussian variable. We denote m = (m'~*'°) the mean (first moment) of m*^" and q ~ ((m*^")^) 
its second moment. Then the mean (first moment) of the sum in the argument of the tanh is /i = pj^pniP^^, and 
its variance a = 13"^ J'^p q^'^ /2. Using the mean and variance we can write m = J e~'^~'^' ^'^^'^^ tanh z dz/V^Tra and 
q = J e-(^-'^)'/(2'^) tanh^zdz/\/2^ which after a substitution gives the usual form of the replica symmetric equation 
for the p-spin model Eqs. (|40j|4ip . first obtained in22: 

2. The free energy calculation 

In the cavity formalism the RS free energy reads 

- /3F - ^ log - (p - 1 ) ^ log , ( A7) 

i a 

where the free energy shifts are 

Z^+o^ ^ ^]-[ ^e/JJ.n,,a.^. Yl ^\ (A8) 

Si bediSj^i j£db\i 
Sj jeda 

Let us now take the fully connected limit. The link term is (we write only the terms with Ji, and as the rest in 
negligible) 

= ^(1 + /3j„ n + 1^'-^') n ^i"" = 1 + If^'Ja + n ^'^^ ■ (aio) 
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Hence 



The site term is a bit trickier. It is useful to remind the following relations 



_ 1 + sm*^° _ 1 + s tanh 



2cosh(/3/i*^°) 



The site term can then be rewritten as 



^ i-l ^ n CAM 2cosh/3/lJ-*f' 



Using trigonometric relation 

^g/3J6s.njea.vs.g/3E, s^'i^^" ^ cosh/3JfcSi 2cosh/3/i^^'' + sinh/3Jf,s, J| 2 sinh /^/i^'^'' 

and odd/even properties of the sinh/cosh functions we have 



En 



2 cosh /3Jt 



1 + Si tanh /3 J;, Oj-gabVi tanh/3/i-'~*'' 



Using relation (jA4[) and (|A12p we get useful form of the site term 



= 2 cosh (/3 u^^') W 



bedi b£di 



cosh /? Jb 
cosh Pu^~*'^ 



(All) 



(A12) 



(A13) 



(AM) 



(A15) 



(A16) 



Only now we start developing the large connectivity limit in which interactions strengths are infinitesimal. Writing 
the site term in terms of messages m^^^ and expanding hyperbolic functions in the leading order we get 



= 2cosh(^/3J6 Y[ m^^'')Y[ 

bedi j£db\i bedi 

= 2cosh(^/3Jb II m-'"^^) H 



cosh /3 Jfc 



coshiPJhUjeObV^'^'') 



bedi jedb\i 

So that the site contribution to the free energy is 



bedi 



]edb\i 



(A17) 
(A18) 



- /3r+^' = j log 2 cosh (l3Jy^pqV-^/2 + /JJopm""') + ^^^(1 - 9^"')- (A19) 
Adding both terms together we get the replica symmetric free energy density of the fully connected p-spin model: 

i/32j2(p-l)qP-/3Jo(p-l)mf+i/3V2-i^V2pgP-i+ ( Vy log 2 cosh i^pjy^p qP-^ /2 + /SJopmP-^^ . (A20) 



3. IRSB solution 



To derive the infinite connectivity limit of the IRSB cavity equations we define the mean and overlap parameters 

7 dP(m*^°)Z({TO'^''},/3)^m'^'' 



VQ{P) 
91 = y VQ{P) 
qo = f VQ{P) 



J dP(7n'^°) Z({m'-^"}, /3)^ 
/ dP(7n'^°)Z({m*^"},/3)^ (m'^°) 



/ dP(m*-^'^) Z({m*^°}, ^)^ 
/ dP(m'^°)Z({m^^°},/3)^m^-^° 



/ dP(TO'^°)Z({TO'^'^},/3)^ 



^ (K^")p)q • 



(A21) 
(A22) 
(A23) 
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where the average over P is over the different states and average over Q is over the different edges in the graph. The 
message m*^" is computed from the incoming messages according to (|A6p . The distribution P(m'~*°) follows 



\ J n^K"'')^'""({"^'""}'/3)"^K"" - , (A24) 



where the equations for m'^" = tanh {f3X) as in (|A6p . where 

bedi\a jedb\i 

Note that that the reweighting factor equals the site term (|A18|) . but only the part is cosh(/3X) is relevant, as the 
rest can be written as 

which is self-averaging and does not depend on the integration variables so it always cancels out as the reweighting 
appears in both the numerator and denominator. 

The argument X is a sum of two Gaussian random variables and can be determined by computing: 

^i = {{X)p)q = JopmP-' , (A27) 
ai ^ {{X^)p)q {{X)p)l = J'^qr' , (A28) 
ao ^ {{X)1)q {{X)p)l = J^^-ql-' . (A29) 

At this point we are able to realize that the average over states (•) p can we written as an Gaussian integral of 
tanhX where the mean of X over states {X)p and the variance cr = {X'^)p — (X)p. The average over the graph 
(•)q is also an average over a Gaussian variable with mean {{X)p)q = fj. and variance ctq = {{^)%)q — {{^)p)q- 
Finally {a)Q = ai — ag. All that gives averaged infinite connectivity IRSB equations (|44M6p . The parameter qi is 
the average self-overlap and qo the average overlap between states. 



Appendix B: Computing the Franz-Parisi potential in diluted models 



We described the connection between the states following method and the Franz-Parisi potential. For completeness 
in this appendix we give the equations according to which the Franz-Parisi potential is computed in the diluted 
(sparse) models. 

The Franz-Parisi potential is the free energy f{q) of the system at temperature /3a depend on the overlap q with 
an equilibrium configuration {ci} at temperature /3e. In order to fix the overlap q we introduce a local uniform field 
h in the direction of the equilibrium configuration. Our goal is then to compute 



fih) 

-/3a/('»,{a.}) 



~l3am{s})+l3ahj:, Sia, 



(Bl) 
(B2) 



The Franz-Parisi potential is then 



fiq) = .fih) + hq, 



dfjh ) 
dh 



= -q- 



(B3) 



To obtain the value of f{q) we need to solve equations similar to Eq. ([ST]) where the field h is taken into account 



=1 Ji=l 



^(W'"},/3e) 



=1 ji=i 
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where 



K-1 li 

nn 



(B5) 



The free energy f{h) is computed from the fixed point of (|B4I) as 



(B6) 



E2(oa-i) /n[dV'>Rs(/) 

7 'J 1 



^'({?},/3e) 



n [dV'^f'^W'O] logZ'({V^},/3a,a,/i).(B7) 



with the /i-dependent partition function contributions being equal to 



K li 



{s,} i=l3.=l 
I 



(B8) 



(B9) 



The overlap is obtained by derivative with respect to h according to (jB3|) . The non-convex parts of f{q) are computed 
by iteratively choosing a new value of h that gives the expected values of the overlap q, in the same manner as total 
magnetization was fixed iniS^iiSi. 

Note that the states following methods developed in this paper corresponds to the Franz-Parisi potential at /t. = 
initialized in the equilibrium configuration. In other words the states following is looking directly at the minimum of 
the Franz-Parisi potential that corresponds to the Gibbs state at temperature (3a. 
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